-- Logs begin at Wed 2022-05-25 13:02:58 UTC, end at Wed 2022-05-25 13:55:47 UTC. -- May 25 13:39:18.689919 dv-cinder-803823-8-smb systemd[1]: Starting Devstack devstack@keystone.service... May 25 13:39:18.699207 dv-cinder-803823-8-smb devstack@keystone.service[86635]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 13:39:18 2022] *** May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: nodename: dv-cinder-803823-8-smb May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: machine: x86_64 May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: clock source: unix May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: pcre jit disabled May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: detected number of CPU cores: 4 May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: current working directory: / May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: detected binary path: /usr/bin/uwsgi-core May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: your processes number limit is 47680 May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: your memory page size is 4096 bytes May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: detected max file descriptor number: 2048 May 25 13:39:18.700811 dv-cinder-803823-8-smb devstack@keystone.service[86635]: lock engine: pthread robust mutexes May 25 13:39:18.702059 dv-cinder-803823-8-smb devstack@keystone.service[86635]: thunder lock: enabled May 25 13:39:18.702059 dv-cinder-803823-8-smb devstack@keystone.service[86635]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 13:39:18.702059 dv-cinder-803823-8-smb devstack@keystone.service[86635]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 13:39:18.747647 dv-cinder-803823-8-smb devstack@keystone.service[86635]: Python main interpreter initialized at 0x559b4cdc89c0 May 25 13:39:18.747647 dv-cinder-803823-8-smb devstack@keystone.service[86635]: python threads support enabled May 25 13:39:18.747647 dv-cinder-803823-8-smb devstack@keystone.service[86635]: your server socket listen backlog is limited to 100 connections May 25 13:39:18.747647 dv-cinder-803823-8-smb devstack@keystone.service[86635]: your mercy for graceful operations on workers is 90 seconds May 25 13:39:18.748038 dv-cinder-803823-8-smb devstack@keystone.service[86635]: mapped 403077 bytes (393 KB) for 2 cores May 25 13:39:18.748143 dv-cinder-803823-8-smb devstack@keystone.service[86635]: *** Operational MODE: preforking *** May 25 13:39:18.748424 dv-cinder-803823-8-smb devstack@keystone.service[86635]: *** uWSGI is running in multiple interpreter mode *** May 25 13:39:18.748424 dv-cinder-803823-8-smb devstack@keystone.service[86635]: spawned uWSGI master process (pid: 86635) May 25 13:39:18.748691 dv-cinder-803823-8-smb systemd[1]: Started Devstack devstack@keystone.service. May 25 13:39:18.749219 dv-cinder-803823-8-smb devstack@keystone.service[86635]: spawned uWSGI worker 1 (pid: 86643, cores: 1) May 25 13:39:18.749560 dv-cinder-803823-8-smb devstack@keystone.service[86635]: spawned uWSGI worker 2 (pid: 86644, cores: 1) May 25 13:39:18.749716 dv-cinder-803823-8-smb devstack@keystone.service[86635]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 13:39:24.709510 dv-cinder-803823-8-smb devstack@keystone.service[86643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 13:39:24.709510 dv-cinder-803823-8-smb devstack@keystone.service[86643]: from cryptography.utils import int_from_bytes May 25 13:39:24.710298 dv-cinder-803823-8-smb devstack@keystone.service[86643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 13:39:24.710298 dv-cinder-803823-8-smb devstack@keystone.service[86643]: from cryptography.utils import int_from_bytes May 25 13:39:24.710418 dv-cinder-803823-8-smb devstack@keystone.service[86644]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 13:39:24.710418 dv-cinder-803823-8-smb devstack@keystone.service[86644]: from cryptography.utils import int_from_bytes May 25 13:39:24.710418 dv-cinder-803823-8-smb devstack@keystone.service[86644]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 13:39:24.710418 dv-cinder-803823-8-smb devstack@keystone.service[86644]: from cryptography.utils import int_from_bytes May 25 13:39:24.762559 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 13:39:24.762794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 13:39:24.762931 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 13:39:24.763059 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] command line args: [] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 13:39:24.763176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 13:39:24.763279 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 13:39:24.763390 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] command line args: [] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 13:39:24.763504 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ================================================================================ {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 13:39:24.763602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 13:39:24.763704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] admin_token = **** {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.763795 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ================================================================================ {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 13:39:24.763892 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] config_dir = [] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.763985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] admin_token = **** {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.764081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.764205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] config_dir = [] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.764303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] config_source = [] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.764424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.764543 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] debug = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.764650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] config_source = [] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.764740 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.765268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] debug = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.765268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.765496 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.765614 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.765720 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.765825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.765931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.766034 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.766147 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.766267 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.766379 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] list_limit = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.766490 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] list_limit = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.766593 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] log_config_append = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.766694 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] log_config_append = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.766808 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.766932 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.767037 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] log_dir = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.767180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] log_dir = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.767293 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] log_file = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.767391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] log_file = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.767511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.767620 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.767719 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.767819 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.767929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.768038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.768724 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.768852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.769047 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.769177 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.769291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.769291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.769586 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.769706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.769881 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.769997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.770113 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.770225 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.770346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.770457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.770648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.770790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.770921 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.771061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.771191 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.771308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.771479 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.771479 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.771763 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.771903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.772014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.772014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] publish_errors = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.772312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.772312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] publish_errors = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.772523 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.772610 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.772730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.772730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.773055 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.773055 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.773255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.773458 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.773553 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.773633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.773710 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] standard_threads = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.773782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] standard_threads = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.773857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.773928 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.774081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.774207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.774343 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.774459 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.774560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] use_journal = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.774639 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] use_journal = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.774758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] use_json = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.774867 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] use_json = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.774979 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] use_stderr = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.775095 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] use_stderr = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.775197 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] use_syslog = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.775316 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] use_syslog = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.775411 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.775491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:39:24.775562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.775632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.775707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.775799 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.775929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.776042 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.776193 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.776313 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.776429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.776535 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.776768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.776866 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.776939 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.777009 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.777117 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.777241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.777347 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.777410 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.777467 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.777523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.777579 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.777635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.777725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.777875 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.778006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.778115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.778232 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.778371 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.778494 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.778618 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.778806 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.778943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.779075 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.779215 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.779330 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.779450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.779569 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.779688 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.779800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.779921 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.780047 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.780185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.780263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.780333 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.780403 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.780486 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.780566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.780638 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.780638 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.780818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.780893 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.781021 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.781098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.781212 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.781286 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.781362 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.781439 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.781591 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.781666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.781742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.781813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.781882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.781951 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.782027 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.782098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.782167 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.782236 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.782310 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.782380 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.782456 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.782527 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.782601 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.782679 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.782750 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.783376 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.783460 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.783537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.783609 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.783678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.783866 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.783866 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.784152 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.784267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.784355 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.784472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.784472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.784648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.784731 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.784731 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.784860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.784929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.785151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.785238 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.785386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.785603 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.785710 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.785849 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.785954 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.786102 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.786208 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.786335 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.786440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.786562 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.786668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.786783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.786892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.787024 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.787234 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.787315 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.787489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.787621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.787741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.787895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.788040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.788240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.788403 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.788526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.788614 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.788736 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.788853 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.789064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.789147 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.789344 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.789462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.789584 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.789736 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.789814 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.790036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.790124 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.790336 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.790450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.790604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.790854 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.790956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.791065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.791169 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.791271 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.791453 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.791574 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.791695 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.791821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.791942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.792091 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.792256 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.792430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.792599 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.792677 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.792906 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.792995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.793149 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.793229 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.793391 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.793479 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.793630 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.793788 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.793864 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.794022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.794100 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.794266 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.794344 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.794519 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.794596 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.794760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.794844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.795042 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.795120 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.795287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.795411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.795527 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.795663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.795768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.795960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.796046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.796250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.796331 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.796486 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.796564 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.796718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.796814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.796956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.797035 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.797188 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.797272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.797432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.797514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.797668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.797748 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.797919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.797997 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.798159 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.798237 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.798404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.799135 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.799259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.799334 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.799451 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.799521 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.799687 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] auth.external = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.799760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.799920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.799998 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.800172 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.800404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.800496 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.800646 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.800723 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.800878 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.800964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] auth.password = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.801111 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] auth.token = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.801240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.801350 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.801428 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.801587 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.801692 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.801841 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.801920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.802076 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.802162 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.802306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] auth.external = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.802384 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.802535 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.802615 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.802788 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.802874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.803028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] credential.caching = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.803098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.803263 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] auth.password = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.803348 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.803492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] auth.token = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.803579 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.803731 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.803811 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.803976 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.804066 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.804253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.804346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.804484 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.804562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.804732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.804813 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.805040 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.805143 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.805220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.805297 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.805419 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] credential.caching = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.805498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.805737 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.805878 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.805955 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.806073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.806155 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.806229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.806369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.806479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.806611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.806741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.806845 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.806981 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] federation.caching = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.807115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.807221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.807369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.807477 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.807606 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.807728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.807859 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.807940 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.808171 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.808266 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.808410 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.808490 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.808667 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.808793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.808909 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.808985 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.809144 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.809227 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.809379 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] federation.caching = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.809460 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.809613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.809691 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.809855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.caching = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.809933 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.810096 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.810176 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.810324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.810402 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.810569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.810649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.810804 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.810890 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.811052 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.811131 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.811284 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.811362 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.811520 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.811599 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.811760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.811838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.812012 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.812091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.812269 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.812350 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.caching = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.812504 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.812583 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.812739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.812817 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.812972 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.813051 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.813204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.813274 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.813448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.813525 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.813675 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.813755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.813908 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.813987 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.814191 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.814338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.814421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.814568 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.814648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.814820 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.814898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.815056 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.815126 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.815299 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.815374 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.815535 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.815604 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.815789 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.815935 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.816038 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.816137 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.816272 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.816351 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.816526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.816607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.816761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.816839 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.816993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.817071 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.817223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.817304 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.817460 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.817528 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.817689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.817774 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.817921 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.818002 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.818160 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.818238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.818398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.818467 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.818634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.818714 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.818856 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.818960 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.819101 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.819185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.819343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.819423 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.819577 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.819656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.819814 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.819892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.820064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.820182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.820306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.820387 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.820541 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.820621 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.820768 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.820849 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.821002 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.821081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.821236 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.821315 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.821478 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.821557 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.821709 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.821787 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.821943 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.822021 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.822178 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.822259 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.822422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.822507 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.822684 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.822870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.822957 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.823153 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.823231 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.823403 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.823482 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.823652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.823738 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.823886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.823964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.824134 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.824217 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.824668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.824786 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.824786 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.824924 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.824995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.825066 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.825137 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.825215 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.825289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.825521 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.825600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.826002 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.826102 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.826188 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.826263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.826335 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.826407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.826683 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.826934 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.827031 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.827108 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.827180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.827256 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.827327 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.827405 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.827535 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.827710 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.827797 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.827998 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.828076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.828276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.828369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.828524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.828604 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.828766 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.828846 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.829017 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.829149 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.829276 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.829404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.829487 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.829560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.829720 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.829805 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.829957 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.830105 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.830184 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.830351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.830440 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.830604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.830682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.830870 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.831010 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.831124 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.831220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.831331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.831411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.831562 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.831645 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] resource.caching = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.831808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.831962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.832039 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.832105 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.832318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.832395 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.832513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.832608 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.832756 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.832864 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.833011 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.833145 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.833277 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.833370 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.833446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.833567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.833680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] resource.caching = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.833811 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.834051 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] role.caching = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.834138 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.834299 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.834378 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] role.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.834530 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.834609 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.834776 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.834878 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.835026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.835108 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.835257 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.835336 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.835504 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.835592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.835748 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.835878 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.836007 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.836165 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.836296 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] role.caching = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.836395 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.836472 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] role.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.836624 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.836705 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.836863 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.836949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.837122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.837258 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.837356 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.837481 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.837610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.837691 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.837859 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.837940 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.838106 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.838307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.838455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.838614 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.838721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.838829 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.838935 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.839034 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.839130 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.839266 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.839438 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.839613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.839722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.839822 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.839920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.840010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.840247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.840361 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.840485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.840567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.840639 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.840750 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.840871 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.840996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.841119 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.841237 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.841366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.841509 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.841609 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.841747 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.841828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.842001 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.842081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.842249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.842387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.842511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.842593 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.842704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.842784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.842943 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] token.caching = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.843026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.843188 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.843293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.843420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.843503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.843663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.843744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.843895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.843973 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.844146 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.844228 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.844387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.844508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.844616 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] token.caching = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.844698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.844851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.844930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.845102 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.845237 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.845853 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.845953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.846093 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.846174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.846338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.846418 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.846569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.846637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.846813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.846890 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.847049 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.847130 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.847292 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.847370 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.847528 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.847672 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.847755 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.847853 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.connection = **** {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.847983 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.848153 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.848271 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.848378 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.848505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.848600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.848732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.848836 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.848973 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.849077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.849267 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.849355 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.849536 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.connection = **** {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.849625 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.849775 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.849855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.850017 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.850096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.850252 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.850372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.850491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.850585 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.850722 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.850804 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.850956 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.851038 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.851187 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.851266 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.851420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.851502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.851700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.851789 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.851864 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.851936 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.852170 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.852254 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.852359 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 13:39:24.852484 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.852602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.852819 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.853058 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.853541 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.853772 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.854003 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:39:24.854170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 13:39:24.885261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.885461 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.885550 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.885654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.885735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.885846 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.894841 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.895276 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.925612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.925914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.926491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.926730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.980886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:24.981728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.040768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.041034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.041362 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.041595 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.115147 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.115368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.115631 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.115790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.116005 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.116209 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.116320 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.116448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.116672 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.116892 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.117114 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.117328 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.140214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.140449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.140543 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.140671 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.140773 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.140891 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.140982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.141106 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.141195 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.141318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.141407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.141529 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.141616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.141755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.154131 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.154493 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.167445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.167671 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.167880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.167972 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.168098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.168210 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.168336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.168425 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.168548 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.168644 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.168760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.168849 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.168974 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.169191 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:39:25.188228 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.188449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 13:39:25.188756 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.188954 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 13:39:25.189186 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.189296 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.189378 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 13:39:25.189491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.189727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.189832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.189915 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 13:39:25.189996 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.190185 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.190444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.190709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.190967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.201026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.201293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.201553 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.201828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.202093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.202371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.202647 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.202928 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.210496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.211840 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.213785 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.214058 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.214333 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.214611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.214889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.215147 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.215266 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.215488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.215576 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.215772 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.215853 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.216036 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.216147 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.216338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.216420 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.216605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.216695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.217000 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.217285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.217553 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.217829 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.218099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.244288 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.246056 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.246346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.246843 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.248754 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.249042 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.251901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.252219 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.252501 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.254628 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.254929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.255213 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.260204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.260506 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.262835 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.263135 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.265176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.265618 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.265904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.266186 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.266468 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.266745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.267016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.267934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.268402 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.268918 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.269216 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.269507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.269791 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.270073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.270350 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.270625 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.287568 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.287854 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.290526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.290827 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.292755 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.295769 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.296549 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.296869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.299700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.300012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.302474 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.305400 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.306165 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.309159 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.310022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.310324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.310616 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.310903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.311188 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.311471 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.313156 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.313489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.313778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.314146 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.314602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.314919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.331887 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.332202 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.332468 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.332725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.334995 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.335301 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.335577 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.335842 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.340824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.342560 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.342843 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.344096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.346780 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.347071 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.347232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.347647 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.351415 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.351415 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.351415 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.351927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.351927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.351927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.351927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.352497 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.366634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.366934 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.367221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.367308 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.367520 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.367605 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.367803 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.367887 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.368090 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.368197 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.368396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.368487 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.368683 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.368965 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.386907 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.387602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.390391 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.391017 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.394425 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.395368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.396066 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.397063 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.397774 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.398078 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.398364 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.398749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.399045 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.399329 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.406049 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.406932 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.407713 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.409348 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.411691 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.411994 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.412317 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.412599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.412786 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.413088 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.413372 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.413649 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.422004 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.422310 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.422718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.422949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.423254 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.423782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.431040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.431328 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.431615 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.431768 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:39:25.431915 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.432042 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.432193 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.432346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.432475 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.432627 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.432792 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.432913 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.433052 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.433257 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.433393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.433512 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.433633 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.433750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.433861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.433996 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.434119 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.434236 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.434353 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.434474 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.434602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.434719 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.434987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.435246 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:39:25.475492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559b4cdc89c0 pid: 86644 (default app) May 25 13:39:25.475790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559b4cdc89c0 pid: 86643 (default app) May 25 13:39:25.479186 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fe8c7-f1c8-4ede-a70d-9b5a5ee4103a None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:25.479480 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fe8c7-f1c8-4ede-a70d-9b5a5ee4103a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:25.479760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fe8c7-f1c8-4ede-a70d-9b5a5ee4103a None None] PATH_INFO: `/v3` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:25.484082 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 791 bytes} [Wed May 25 13:39:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:33.641292 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ef43b-2f95-4bac-a6fd-f0d5e70f58a4 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:33.642289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ef43b-2f95-4bac-a6fd-f0d5e70f58a4 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:33.642409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ef43b-2f95-4bac-a6fd-f0d5e70f58a4 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:33.647056 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 1/2] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:39:33.652319 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2c6fc-c63d-4d04-b759-40b93015913c None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:33.652819 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2c6fc-c63d-4d04-b759-40b93015913c None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:33.652903 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2c6fc-c63d-4d04-b759-40b93015913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:33.722383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: INFO dbcounter [None req-cfe2c6fc-c63d-4d04-b759-40b93015913c None None] Registered counter for database keystone May 25 13:39:33.744799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG oslo_db.sqlalchemy.engines [None req-cfe2c6fc-c63d-4d04-b759-40b93015913c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 13:39:33.753511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writer thread running {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 13:39:33.933299 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG passlib.handlers.bcrypt [None req-cfe2c6fc-c63d-4d04-b759-40b93015913c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86644) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 13:39:33.933639 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG passlib.handlers.bcrypt [None req-cfe2c6fc-c63d-4d04-b759-40b93015913c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86644) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 13:39:33.991794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-cfe2c6fc-c63d-4d04-b759-40b93015913c None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:33.993479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-cfe2c6fc-c63d-4d04-b759-40b93015913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:34.122557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 2/3] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 13:39:34.290263 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ef43b-2f95-4bac-a6fd-f0d5e70f58a4 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:34.429581 dv-cinder-803823-8-smb devstack@keystone.service[86643]: INFO dbcounter [None req-104ef43b-2f95-4bac-a6fd-f0d5e70f58a4 None None] Registered counter for database keystone May 25 13:39:34.463745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG oslo_db.sqlalchemy.engines [None req-104ef43b-2f95-4bac-a6fd-f0d5e70f58a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 13:39:34.473845 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writer thread running {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 13:39:34.634096 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ef43b-2f95-4bac-a6fd-f0d5e70f58a4 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:34.638514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c07025-1197-44e0-9368-248dc005a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:34.639191 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07025-1197-44e0-9368-248dc005a7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:34.639483 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07025-1197-44e0-9368-248dc005a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:34.639765 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07025-1197-44e0-9368-248dc005a7d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:34.648408 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c07025-1197-44e0-9368-248dc005a7d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:34.700163 dv-cinder-803823-8-smb devstack@keystone.service[86643]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c1c07025-1197-44e0-9368-248dc005a7d0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 13:39:34.700493 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c07025-1197-44e0-9368-248dc005a7d0 admin admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:34.713063 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 2/4] 10.222.0.24 () {58 vars in 1324 bytes} [Wed May 25 13:39:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 13:39:34.719212 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2c6fc-c63d-4d04-b759-40b93015913c None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:34.735298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2c6fc-c63d-4d04-b759-40b93015913c None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:34.741493 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f8bfe-15de-4f9c-a894-077b926c3df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:34.742517 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f8bfe-15de-4f9c-a894-077b926c3df1 admin admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:34.742804 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f8bfe-15de-4f9c-a894-077b926c3df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:34.743096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f8bfe-15de-4f9c-a894-077b926c3df1 admin admin] PATH_INFO: `/v3/projects/909371a65bb348a1b58a2f6624e12486` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:34.744708 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f8bfe-15de-4f9c-a894-077b926c3df1 admin admin] RBAC: Authorizing `identity:get_project(project_id=909371a65bb348a1b58a2f6624e12486)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:34.909225 dv-cinder-803823-8-smb devstack@keystone.service[86644]: WARNING keystone.common.rbac_enforcer.enforcer [None req-537f8bfe-15de-4f9c-a894-077b926c3df1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 13:39:34.909520 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f8bfe-15de-4f9c-a894-077b926c3df1 admin admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:34.914794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 3/5] 10.222.0.24 () {56 vars in 1207 bytes} [Wed May 25 13:39:34 2022] GET /identity/v3/projects/909371a65bb348a1b58a2f6624e12486 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:37.140915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43edd54-4128-4c15-aec2-d03cfffbc561 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:37.141494 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43edd54-4128-4c15-aec2-d03cfffbc561 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:37.141494 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43edd54-4128-4c15-aec2-d03cfffbc561 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:37.151947 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 3/6] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:37.158827 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb6b76-28dd-48d9-b3ae-0311284ad6b6 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:37.159312 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb6b76-28dd-48d9-b3ae-0311284ad6b6 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:37.159396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb6b76-28dd-48d9-b3ae-0311284ad6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:37.178707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-73fb6b76-28dd-48d9-b3ae-0311284ad6b6 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:37.180327 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-73fb6b76-28dd-48d9-b3ae-0311284ad6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:37.188355 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 4/7] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 13:39:37.211670 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43edd54-4128-4c15-aec2-d03cfffbc561 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:37.224689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43edd54-4128-4c15-aec2-d03cfffbc561 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:37.229101 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27612cde-4eb3-47d5-83cf-43db8c9c3fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:37.229739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27612cde-4eb3-47d5-83cf-43db8c9c3fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:37.230020 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27612cde-4eb3-47d5-83cf-43db8c9c3fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:37.230297 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27612cde-4eb3-47d5-83cf-43db8c9c3fd5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:37.238483 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27612cde-4eb3-47d5-83cf-43db8c9c3fd5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:37.240289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27612cde-4eb3-47d5-83cf-43db8c9c3fd5 admin admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:37.249321 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 4/8] 10.222.0.24 () {58 vars in 1324 bytes} [Wed May 25 13:39:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 13:39:37.255142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb6b76-28dd-48d9-b3ae-0311284ad6b6 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:37.264487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb6b76-28dd-48d9-b3ae-0311284ad6b6 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:37.269672 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeff7f4-73dc-4805-a1e6-442609d0e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:37.270550 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeff7f4-73dc-4805-a1e6-442609d0e312 admin admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:37.270838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeff7f4-73dc-4805-a1e6-442609d0e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:37.271117 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeff7f4-73dc-4805-a1e6-442609d0e312 admin admin] PATH_INFO: `/v3/users/aa8d5e1bfe92436d9d6f59e103786334` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:37.272579 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeff7f4-73dc-4805-a1e6-442609d0e312 admin admin] RBAC: Authorizing `identity:get_user(user_id=aa8d5e1bfe92436d9d6f59e103786334)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:37.274442 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeff7f4-73dc-4805-a1e6-442609d0e312 admin admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:37.276050 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 5/9] 10.222.0.24 () {56 vars in 1198 bytes} [Wed May 25 13:39:37 2022] GET /identity/v3/users/aa8d5e1bfe92436d9d6f59e103786334 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:39.586250 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcac2b-1c91-4b06-bf62-563ea651497b None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:39.586795 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcac2b-1c91-4b06-bf62-563ea651497b None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:39.586795 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcac2b-1c91-4b06-bf62-563ea651497b None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:39.588249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 5/10] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:39:39.593605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c447834-5307-4f3f-afdd-a8be5b9247a4 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:39.594052 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c447834-5307-4f3f-afdd-a8be5b9247a4 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:39.594175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c447834-5307-4f3f-afdd-a8be5b9247a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:39.611960 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-7c447834-5307-4f3f-afdd-a8be5b9247a4 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:39.613189 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-7c447834-5307-4f3f-afdd-a8be5b9247a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:39.625492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf2be8-0a00-475c-add5-809676763e74 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:39.625782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf2be8-0a00-475c-add5-809676763e74 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:39.626112 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf2be8-0a00-475c-add5-809676763e74 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:39.627698 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 6/11] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:39.632668 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9b41f-e3d6-43c5-a630-7bed710404dd None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:39.632963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9b41f-e3d6-43c5-a630-7bed710404dd None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:39.633248 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9b41f-e3d6-43c5-a630-7bed710404dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:39.674470 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG passlib.handlers.bcrypt [None req-a0d9b41f-e3d6-43c5-a630-7bed710404dd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86643) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 13:39:39.674910 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG passlib.handlers.bcrypt [None req-a0d9b41f-e3d6-43c5-a630-7bed710404dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86643) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 13:39:39.695814 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 6/12] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:39:39.718825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c447834-5307-4f3f-afdd-a8be5b9247a4 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:39.723704 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-a0d9b41f-e3d6-43c5-a630-7bed710404dd None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:39.725364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-a0d9b41f-e3d6-43c5-a630-7bed710404dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:39.743503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:39.828262 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 7/13] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:39:39.828671 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c447834-5307-4f3f-afdd-a8be5b9247a4 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:39.850960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9b41f-e3d6-43c5-a630-7bed710404dd None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:39.866205 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a4f8c-3eb0-4930-a9ba-7b2bee4dcbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:39.867010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a4f8c-3eb0-4930-a9ba-7b2bee4dcbf7 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:39.867306 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a4f8c-3eb0-4930-a9ba-7b2bee4dcbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:39.867593 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a4f8c-3eb0-4930-a9ba-7b2bee4dcbf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:39.880029 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a4f8c-3eb0-4930-a9ba-7b2bee4dcbf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-1a1a4f8c-3eb0-4930-a9ba-7b2bee4dcbf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:39:39.891326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:39.893242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:39:39.894204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 7/14] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:39:39.899104 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a4f8c-3eb0-4930-a9ba-7b2bee4dcbf7 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:39.986655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:40.007146 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a4f8c-3eb0-4930-a9ba-7b2bee4dcbf7 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:40.044358 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606192ad-be8b-49c6-9bbe-491340a5840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:40.045032 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606192ad-be8b-49c6-9bbe-491340a5840c None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:40.045317 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606192ad-be8b-49c6-9bbe-491340a5840c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:40.045594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606192ad-be8b-49c6-9bbe-491340a5840c None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:40.046364 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606192ad-be8b-49c6-9bbe-491340a5840c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:40.046674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606192ad-be8b-49c6-9bbe-491340a5840c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:40.048690 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606192ad-be8b-49c6-9bbe-491340a5840c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:40.060914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 8/15] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:39:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:40.067186 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606192ad-be8b-49c6-9bbe-491340a5840c None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:40.070279 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9b41f-e3d6-43c5-a630-7bed710404dd None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:40.072708 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:40.109419 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abca2e0-cfe5-4460-8f5e-8867f075faa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:40.110803 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abca2e0-cfe5-4460-8f5e-8867f075faa3 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:40.111023 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abca2e0-cfe5-4460-8f5e-8867f075faa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:40.111663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abca2e0-cfe5-4460-8f5e-8867f075faa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:40.174725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606192ad-be8b-49c6-9bbe-491340a5840c None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:40.182553 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abca2e0-cfe5-4460-8f5e-8867f075faa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:40.184150 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abca2e0-cfe5-4460-8f5e-8867f075faa3 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:40.218928 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd912826-c457-41ca-82da-82ab1d08c735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:40.219919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd912826-c457-41ca-82da-82ab1d08c735 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:40.220235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd912826-c457-41ca-82da-82ab1d08c735 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:40.220523 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd912826-c457-41ca-82da-82ab1d08c735 None admin] PATH_INFO: `/v3/users/aa8d5e1bfe92436d9d6f59e103786334` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:40.221800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd912826-c457-41ca-82da-82ab1d08c735 None admin] RBAC: Authorizing `identity:get_user(user_id=aa8d5e1bfe92436d9d6f59e103786334)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:40.223304 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd912826-c457-41ca-82da-82ab1d08c735 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:40.225024 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 9/16] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:39:40 2022] GET /identity/v3/users/aa8d5e1bfe92436d9d6f59e103786334 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:40.230780 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd912826-c457-41ca-82da-82ab1d08c735 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:40.246327 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:40.293130 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 8/17] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:39:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:39:40.298814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abca2e0-cfe5-4460-8f5e-8867f075faa3 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:40.302048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:40.349599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd912826-c457-41ca-82da-82ab1d08c735 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:40.385288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e05115-634b-43e3-89c8-e482f57d300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:40.386245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05115-634b-43e3-89c8-e482f57d300a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:40.386601 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05115-634b-43e3-89c8-e482f57d300a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:40.386889 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05115-634b-43e3-89c8-e482f57d300a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:40.388103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e05115-634b-43e3-89c8-e482f57d300a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:40.389678 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e05115-634b-43e3-89c8-e482f57d300a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:40.391296 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 10/18] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:39:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:40.397770 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e05115-634b-43e3-89c8-e482f57d300a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:40.405323 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abca2e0-cfe5-4460-8f5e-8867f075faa3 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:40.441292 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f684b-a984-4d84-8d4d-ac4bf2f38595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:40.442425 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f684b-a984-4d84-8d4d-ac4bf2f38595 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:40.442425 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f684b-a984-4d84-8d4d-ac4bf2f38595 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:40.442647 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f684b-a984-4d84-8d4d-ac4bf2f38595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:40.462926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f684b-a984-4d84-8d4d-ac4bf2f38595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:40.464451 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f684b-a984-4d84-8d4d-ac4bf2f38595 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:40.484949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-819f684b-a984-4d84-8d4d-ac4bf2f38595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:39:40.486666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:40.487469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:40.488635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:39:40.488635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:39:40.488635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:40.488635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:39:40.488635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 9/19] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:39:40.494048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f684b-a984-4d84-8d4d-ac4bf2f38595 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:40.512488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e05115-634b-43e3-89c8-e482f57d300a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:40.562785 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046ac4-c9e7-4ec8-ba65-1575df5331e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:40.564004 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046ac4-c9e7-4ec8-ba65-1575df5331e3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:40.564447 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046ac4-c9e7-4ec8-ba65-1575df5331e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:40.564946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046ac4-c9e7-4ec8-ba65-1575df5331e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:40.565778 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:40.566736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7046ac4-c9e7-4ec8-ba65-1575df5331e3 None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.domain.id=default, user.id=aa8d5e1bfe92436d9d6f59e103786334) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:40.567062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7046ac4-c9e7-4ec8-ba65-1575df5331e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:40.569416 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7046ac4-c9e7-4ec8-ba65-1575df5331e3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:40.577373 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 11/20] 10.222.0.24 () {56 vars in 1322 bytes} [Wed May 25 13:39:40 2022] GET /identity/v3/role_assignments?user.id=aa8d5e1bfe92436d9d6f59e103786334&scope.domain.id=default&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 233 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:40.617318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f684b-a984-4d84-8d4d-ac4bf2f38595 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:40.656893 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d5e7a-e2d9-43a0-8a28-6d322e8e8367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:40.657524 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d5e7a-e2d9-43a0-8a28-6d322e8e8367 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:40.657807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d5e7a-e2d9-43a0-8a28-6d322e8e8367 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:40.658118 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d5e7a-e2d9-43a0-8a28-6d322e8e8367 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:40.658884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d5e7a-e2d9-43a0-8a28-6d322e8e8367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:40.659195 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d5e7a-e2d9-43a0-8a28-6d322e8e8367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:40.660699 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d5e7a-e2d9-43a0-8a28-6d322e8e8367 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:40.681505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 10/21] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:43.262801 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9d1bc-8e24-4893-98ab-3c25d9527955 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:43.263339 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9d1bc-8e24-4893-98ab-3c25d9527955 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:43.263339 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9d1bc-8e24-4893-98ab-3c25d9527955 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:43.265123 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 12/22] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:43.276314 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9588289-c5a6-4370-a6e7-e05bacded1aa None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:43.276839 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9588289-c5a6-4370-a6e7-e05bacded1aa None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:43.276924 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9588289-c5a6-4370-a6e7-e05bacded1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:43.303823 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-d9588289-c5a6-4370-a6e7-e05bacded1aa None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:43.305120 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-d9588289-c5a6-4370-a6e7-e05bacded1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:43.401492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 11/23] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:39:43.441996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9d1bc-8e24-4893-98ab-3c25d9527955 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:43.476244 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a35417-273c-4da4-b73d-195ddcfef2d1 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:43.476543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a35417-273c-4da4-b73d-195ddcfef2d1 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:43.476819 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a35417-273c-4da4-b73d-195ddcfef2d1 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:43.478763 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 12/24] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:43.489369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7cbe9-eaee-46aa-8ddd-14db1755b51e None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:43.489660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7cbe9-eaee-46aa-8ddd-14db1755b51e None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:43.489929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7cbe9-eaee-46aa-8ddd-14db1755b51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:43.533838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-c1b7cbe9-eaee-46aa-8ddd-14db1755b51e None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:43.535383 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-c1b7cbe9-eaee-46aa-8ddd-14db1755b51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:43.629578 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:43.659904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 13/25] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:39:43.661072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642a7c3-6109-4b9f-b74d-08001bd8e7ce None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:43.661361 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642a7c3-6109-4b9f-b74d-08001bd8e7ce None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:43.661641 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642a7c3-6109-4b9f-b74d-08001bd8e7ce None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:43.663197 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 14/26] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:43.672325 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9d1bc-8e24-4893-98ab-3c25d9527955 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:43.681555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ca162-e130-40fd-80f6-ba27d1ed4514 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:43.681844 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ca162-e130-40fd-80f6-ba27d1ed4514 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:43.682116 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ca162-e130-40fd-80f6-ba27d1ed4514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:43.727593 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-ea3ca162-e130-40fd-80f6-ba27d1ed4514 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:43.729119 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-ea3ca162-e130-40fd-80f6-ba27d1ed4514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:43.769960 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d269a3-a073-49ce-a130-66562a7d2845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:43.770775 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d269a3-a073-49ce-a130-66562a7d2845 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:43.771058 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d269a3-a073-49ce-a130-66562a7d2845 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:43.771334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d269a3-a073-49ce-a130-66562a7d2845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:43.796518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d269a3-a073-49ce-a130-66562a7d2845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-f9d269a3-a073-49ce-a130-66562a7d2845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:39:43.812698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:43.813742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:43.814641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:43.814641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:43.814641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:43.814641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:43.814641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:39:43.814641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:39:43.814641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:39:43.814641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:39:43.814641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:39:43.814641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:39:43.814641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:39:43.814641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:39:43.816101 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 13/27] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:39:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:43.816101 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d269a3-a073-49ce-a130-66562a7d2845 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:43.832539 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:43.886996 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 15/28] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:39:43.887895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ca162-e130-40fd-80f6-ba27d1ed4514 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:43.991256 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d269a3-a073-49ce-a130-66562a7d2845 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:44.040393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ca162-e130-40fd-80f6-ba27d1ed4514 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:44.041852 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756665b-cf8c-4a9e-b610-a150a0470c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:44.042734 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756665b-cf8c-4a9e-b610-a150a0470c7d None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:44.043023 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756665b-cf8c-4a9e-b610-a150a0470c7d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:44.043297 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756665b-cf8c-4a9e-b610-a150a0470c7d None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:44.044218 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756665b-cf8c-4a9e-b610-a150a0470c7d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:44.045649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756665b-cf8c-4a9e-b610-a150a0470c7d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:44.051359 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:44.089176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3084ad4-effa-46c9-9bff-2f3c49917b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:44.090309 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3084ad4-effa-46c9-9bff-2f3c49917b2d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:44.090916 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3084ad4-effa-46c9-9bff-2f3c49917b2d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:44.091395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3084ad4-effa-46c9-9bff-2f3c49917b2d None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:44.092470 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3084ad4-effa-46c9-9bff-2f3c49917b2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:44.093105 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3084ad4-effa-46c9-9bff-2f3c49917b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:44.094853 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3084ad4-effa-46c9-9bff-2f3c49917b2d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:44.109480 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 16/29] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:39:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:44.112192 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97797bbe-a162-44f5-b475-5bd1584062fe None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:44.112725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97797bbe-a162-44f5-b475-5bd1584062fe None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:44.113227 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97797bbe-a162-44f5-b475-5bd1584062fe None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:44.119538 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 17/30] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:44.120762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97797bbe-a162-44f5-b475-5bd1584062fe None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:44.210900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 14/31] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 13:39:43 2022] POST /identity/v3/roles => generated 219 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:39:44.212346 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756665b-cf8c-4a9e-b610-a150a0470c7d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:44.276093 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97797bbe-a162-44f5-b475-5bd1584062fe None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:44.327706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:44.369391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93edab-37df-45c6-a441-8ed63217f1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:44.371125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93edab-37df-45c6-a441-8ed63217f1f9 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:44.371616 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93edab-37df-45c6-a441-8ed63217f1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:44.372091 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93edab-37df-45c6-a441-8ed63217f1f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:44.384801 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93edab-37df-45c6-a441-8ed63217f1f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:44.386718 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93edab-37df-45c6-a441-8ed63217f1f9 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-4c93edab-37df-45c6-a441-8ed63217f1f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:39:44.408104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:44.409046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:44.409830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:39:44.409830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:39:44.409830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:44.409830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:39:44.412388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 18/32] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:44.418620 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f9dc-d2e0-4323-82ac-279060e4b791 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:44.419477 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f9dc-d2e0-4323-82ac-279060e4b791 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:44.419967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f9dc-d2e0-4323-82ac-279060e4b791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:44.439174 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-0920f9dc-d2e0-4323-82ac-279060e4b791 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:44.440860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-0920f9dc-d2e0-4323-82ac-279060e4b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:44.456663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756665b-cf8c-4a9e-b610-a150a0470c7d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:44.468950 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:44.506809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc201ad-4d08-445b-a7a5-05644158981a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:44.507967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc201ad-4d08-445b-a7a5-05644158981a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:44.508423 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc201ad-4d08-445b-a7a5-05644158981a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:44.509023 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc201ad-4d08-445b-a7a5-05644158981a None admin] PATH_INFO: `/v3/users/aa8d5e1bfe92436d9d6f59e103786334` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:44.510531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc201ad-4d08-445b-a7a5-05644158981a None admin] RBAC: Authorizing `identity:get_user(user_id=aa8d5e1bfe92436d9d6f59e103786334)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:44.512595 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc201ad-4d08-445b-a7a5-05644158981a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:44.514909 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 15/33] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:39:44 2022] GET /identity/v3/users/aa8d5e1bfe92436d9d6f59e103786334 => generated 247 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:44.515925 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc201ad-4d08-445b-a7a5-05644158981a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:44.548966 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 19/34] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:39:44.550157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f9dc-d2e0-4323-82ac-279060e4b791 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:44.648309 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc201ad-4d08-445b-a7a5-05644158981a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:44.682432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:44.688392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2141e0-51da-415a-82f7-fde345e60afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:44.688765 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f9dc-d2e0-4323-82ac-279060e4b791 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:44.689443 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2141e0-51da-415a-82f7-fde345e60afb None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:44.689738 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2141e0-51da-415a-82f7-fde345e60afb None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:44.690020 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2141e0-51da-415a-82f7-fde345e60afb None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:44.690765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2141e0-51da-415a-82f7-fde345e60afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:44.691077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2141e0-51da-415a-82f7-fde345e60afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:44.693381 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2141e0-51da-415a-82f7-fde345e60afb None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:44.713544 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 16/35] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:44.714822 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2141e0-51da-415a-82f7-fde345e60afb None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:44.735285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bded3af-afa6-4978-86a8-19d4cfca8041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:44.736365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bded3af-afa6-4978-86a8-19d4cfca8041 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:44.736724 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bded3af-afa6-4978-86a8-19d4cfca8041 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:44.737079 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bded3af-afa6-4978-86a8-19d4cfca8041 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:44.738740 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bded3af-afa6-4978-86a8-19d4cfca8041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:44.740397 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bded3af-afa6-4978-86a8-19d4cfca8041 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:44.742220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 20/36] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:39:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:44.743055 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bded3af-afa6-4978-86a8-19d4cfca8041 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:44.763994 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:44.840408 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2141e0-51da-415a-82f7-fde345e60afb None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:44.860839 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bded3af-afa6-4978-86a8-19d4cfca8041 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:44.881233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237a0ce-ce79-434d-9b85-afb822e4fde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:44.882145 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a0ce-ce79-434d-9b85-afb822e4fde5 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:44.882574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a0ce-ce79-434d-9b85-afb822e4fde5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:44.883017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a0ce-ce79-434d-9b85-afb822e4fde5 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:44.884079 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237a0ce-ce79-434d-9b85-afb822e4fde5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:44.885797 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237a0ce-ce79-434d-9b85-afb822e4fde5 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:44.903511 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935ee38-8e48-479c-bf02-5242f24a84cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:44.904423 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935ee38-8e48-479c-bf02-5242f24a84cf None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:44.904915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935ee38-8e48-479c-bf02-5242f24a84cf None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:44.905369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935ee38-8e48-479c-bf02-5242f24a84cf None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:44.906301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935ee38-8e48-479c-bf02-5242f24a84cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:44.908523 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 17/37] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 13:39:44 2022] POST /identity/v3/roles => generated 225 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:39:44.909375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935ee38-8e48-479c-bf02-5242f24a84cf None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:44.909688 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237a0ce-ce79-434d-9b85-afb822e4fde5 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:45.035183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:45.096980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237a0ce-ce79-434d-9b85-afb822e4fde5 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:45.101731 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 21/38] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:39:44 2022] POST /identity/v3/projects => generated 301 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:39:45.103827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fe824-b5b9-4b89-bba0-827cc6388029 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:45.104355 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fe824-b5b9-4b89-bba0-827cc6388029 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:45.104799 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fe824-b5b9-4b89-bba0-827cc6388029 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:45.107027 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 22/39] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:45.118397 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3602-8584-4f2b-a275-910a9da0fccf None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:45.118938 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3602-8584-4f2b-a275-910a9da0fccf None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:45.119367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3602-8584-4f2b-a275-910a9da0fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:45.143031 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-af2b3602-8584-4f2b-a275-910a9da0fccf None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:45.145454 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-af2b3602-8584-4f2b-a275-910a9da0fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:45.188785 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01c4c3-4e78-4a1b-b48a-cde8600d0165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:45.189686 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01c4c3-4e78-4a1b-b48a-cde8600d0165 None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:45.189976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01c4c3-4e78-4a1b-b48a-cde8600d0165 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:45.190263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01c4c3-4e78-4a1b-b48a-cde8600d0165 None admin] PATH_INFO: `/v3/domains/default/users/aa8d5e1bfe92436d9d6f59e103786334/roles/109ea861e27e4d75bec3ac9c5f81096e` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:45.192778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01c4c3-4e78-4a1b-b48a-cde8600d0165 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=aa8d5e1bfe92436d9d6f59e103786334, role_id=109ea861e27e4d75bec3ac9c5f81096e)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:45.194321 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01c4c3-4e78-4a1b-b48a-cde8600d0165 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:45.216468 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 18/40] 10.222.0.24 () {58 vars in 1361 bytes} [Wed May 25 13:39:44 2022] PUT /identity/v3/domains/default/users/aa8d5e1bfe92436d9d6f59e103786334/roles/109ea861e27e4d75bec3ac9c5f81096e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:39:45.222273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23659c0c-949b-45ca-aee1-921a6ed4507d None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:45.222616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23659c0c-949b-45ca-aee1-921a6ed4507d None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:45.222992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23659c0c-949b-45ca-aee1-921a6ed4507d None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:45.225046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 19/41] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:45.232863 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1137-328b-4bbf-a75f-fd8ac9777094 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:45.233162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1137-328b-4bbf-a75f-fd8ac9777094 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:45.233522 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1137-328b-4bbf-a75f-fd8ac9777094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:45.244715 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:45.253197 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 23/42] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:39:45.264233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-942d1137-328b-4bbf-a75f-fd8ac9777094 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:45.266111 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-942d1137-328b-4bbf-a75f-fd8ac9777094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:45.287427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b3602-8584-4f2b-a275-910a9da0fccf None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:45.371622 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 20/43] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:39:45.396867 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1137-328b-4bbf-a75f-fd8ac9777094 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:45.437698 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b3602-8584-4f2b-a275-910a9da0fccf None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:45.458382 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:45.484262 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebbb2e-a130-4430-918c-372b305bc035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:45.485990 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebbb2e-a130-4430-918c-372b305bc035 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:45.486458 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebbb2e-a130-4430-918c-372b305bc035 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:45.487003 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebbb2e-a130-4430-918c-372b305bc035 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:45.488494 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebbb2e-a130-4430-918c-372b305bc035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:45.490280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebbb2e-a130-4430-918c-372b305bc035 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:45.492152 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 24/44] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:39:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:45.498515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebbb2e-a130-4430-918c-372b305bc035 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:45.533504 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1137-328b-4bbf-a75f-fd8ac9777094 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:45.573953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcb6c5-7fe2-461c-b644-2938d29f6818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:45.574632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcb6c5-7fe2-461c-b644-2938d29f6818 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:45.574918 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcb6c5-7fe2-461c-b644-2938d29f6818 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:45.575194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcb6c5-7fe2-461c-b644-2938d29f6818 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:45.575958 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcb6c5-7fe2-461c-b644-2938d29f6818 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:45.577380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcb6c5-7fe2-461c-b644-2938d29f6818 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:45.579196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:45.600152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 21/45] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 13:39:45 2022] POST /identity/v3/roles => generated 223 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:39:45.635492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebbb2e-a130-4430-918c-372b305bc035 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:45.675450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a6723-7d34-481d-9603-9c6f77448269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:45.676165 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a6723-7d34-481d-9603-9c6f77448269 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:45.676458 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a6723-7d34-481d-9603-9c6f77448269 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:45.676744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a6723-7d34-481d-9603-9c6f77448269 None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:45.677477 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a6723-7d34-481d-9603-9c6f77448269 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:45.678969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a6723-7d34-481d-9603-9c6f77448269 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:45.716399 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 25/46] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:39:45 2022] POST /identity/v3/projects => generated 312 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:39:47.501902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b31a1-8f16-49f0-96c7-e9846e2f94ca None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:47.502427 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b31a1-8f16-49f0-96c7-e9846e2f94ca None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:47.502531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b31a1-8f16-49f0-96c7-e9846e2f94ca None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:47.503945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 22/47] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:47.509558 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f32977-ff4c-47ba-b3ff-50984471e44d None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:47.510103 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f32977-ff4c-47ba-b3ff-50984471e44d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:47.510191 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f32977-ff4c-47ba-b3ff-50984471e44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:47.527022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-c2f32977-ff4c-47ba-b3ff-50984471e44d None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:47.528288 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-c2f32977-ff4c-47ba-b3ff-50984471e44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:47.598369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 26/48] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:39:47.621703 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b31a1-8f16-49f0-96c7-e9846e2f94ca None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:47.727297 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b31a1-8f16-49f0-96c7-e9846e2f94ca None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:47.729206 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:47.765078 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343ce50-ee90-4c7d-a728-db33482ed7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:47.765808 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343ce50-ee90-4c7d-a728-db33482ed7fc None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:47.766092 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343ce50-ee90-4c7d-a728-db33482ed7fc None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:47.766890 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343ce50-ee90-4c7d-a728-db33482ed7fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:47.779059 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343ce50-ee90-4c7d-a728-db33482ed7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-9343ce50-ee90-4c7d-a728-db33482ed7fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:39:47.787605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:47.788718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:39:47.789488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 23/49] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:39:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:47.794709 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f32977-ff4c-47ba-b3ff-50984471e44d None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:47.846175 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:47.902031 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f32977-ff4c-47ba-b3ff-50984471e44d None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:47.936032 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb950e3d-5159-4ad8-8c5f-ec84c389c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:47.936786 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb950e3d-5159-4ad8-8c5f-ec84c389c20c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:47.937035 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb950e3d-5159-4ad8-8c5f-ec84c389c20c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:47.937319 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb950e3d-5159-4ad8-8c5f-ec84c389c20c None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:47.938607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb950e3d-5159-4ad8-8c5f-ec84c389c20c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:47.939053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb950e3d-5159-4ad8-8c5f-ec84c389c20c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:47.940505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb950e3d-5159-4ad8-8c5f-ec84c389c20c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:47.948699 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 27/50] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:39:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:47.951914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257e86a-39b9-4b08-ad15-8236bba9633a None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:47.952314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257e86a-39b9-4b08-ad15-8236bba9633a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:47.952664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257e86a-39b9-4b08-ad15-8236bba9633a None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:47.954631 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb950e3d-5159-4ad8-8c5f-ec84c389c20c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:47.954736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 24/51] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:47.959631 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610ec21-653d-4857-a9bc-e5daed0282f2 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:47.959920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610ec21-653d-4857-a9bc-e5daed0282f2 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:47.960235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610ec21-653d-4857-a9bc-e5daed0282f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:47.976612 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-1610ec21-653d-4857-a9bc-e5daed0282f2 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:47.977827 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-1610ec21-653d-4857-a9bc-e5daed0282f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:48.045130 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 25/52] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:39:48.054266 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb950e3d-5159-4ad8-8c5f-ec84c389c20c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:48.068395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:48.068578 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610ec21-653d-4857-a9bc-e5daed0282f2 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:48.090340 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642f8d-1591-413d-b042-f4a8aa758fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:48.091223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642f8d-1591-413d-b042-f4a8aa758fab None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:48.091510 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642f8d-1591-413d-b042-f4a8aa758fab None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:48.091791 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642f8d-1591-413d-b042-f4a8aa758fab None admin] PATH_INFO: `/v3/users/aa8d5e1bfe92436d9d6f59e103786334` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:48.093273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1642f8d-1591-413d-b042-f4a8aa758fab None admin] RBAC: Authorizing `identity:get_user(user_id=aa8d5e1bfe92436d9d6f59e103786334)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:48.095014 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1642f8d-1591-413d-b042-f4a8aa758fab None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:48.096699 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 28/53] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:39:47 2022] GET /identity/v3/users/aa8d5e1bfe92436d9d6f59e103786334 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:48.102122 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642f8d-1591-413d-b042-f4a8aa758fab None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:48.159431 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:48.169886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610ec21-653d-4857-a9bc-e5daed0282f2 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:48.205509 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642f8d-1591-413d-b042-f4a8aa758fab None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:48.207340 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb8762-1478-41bd-b2b2-ff0491e35ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:48.208171 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb8762-1478-41bd-b2b2-ff0491e35ad7 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:48.208456 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb8762-1478-41bd-b2b2-ff0491e35ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:48.208735 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb8762-1478-41bd-b2b2-ff0491e35ad7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:48.209922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb8762-1478-41bd-b2b2-ff0491e35ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:48.211397 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb8762-1478-41bd-b2b2-ff0491e35ad7 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:48.213051 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 26/54] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:39:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:48.218452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb8762-1478-41bd-b2b2-ff0491e35ad7 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:48.239993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f775-f6bb-47d1-9fb3-942214c32832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:48.240835 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f775-f6bb-47d1-9fb3-942214c32832 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:48.241129 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f775-f6bb-47d1-9fb3-942214c32832 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:48.241416 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f775-f6bb-47d1-9fb3-942214c32832 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:48.242633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80f775-f6bb-47d1-9fb3-942214c32832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:48.244085 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80f775-f6bb-47d1-9fb3-942214c32832 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:48.245767 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 29/55] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:39:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:48.252081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f775-f6bb-47d1-9fb3-942214c32832 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:48.301307 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:48.321956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb8762-1478-41bd-b2b2-ff0491e35ad7 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:48.352192 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f775-f6bb-47d1-9fb3-942214c32832 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:48.355529 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486cfb6-7f9b-4354-9e09-b24443fda8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:48.356219 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486cfb6-7f9b-4354-9e09-b24443fda8e3 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:48.356509 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486cfb6-7f9b-4354-9e09-b24443fda8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:48.356785 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486cfb6-7f9b-4354-9e09-b24443fda8e3 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:48.357502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486cfb6-7f9b-4354-9e09-b24443fda8e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:48.358970 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486cfb6-7f9b-4354-9e09-b24443fda8e3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:48.386521 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682b9c0-577b-4bf8-9fe3-3f2335bf1251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:48.386719 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 27/56] 10.222.0.24 () {60 vars in 1140 bytes} [Wed May 25 13:39:48 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:39:48.387472 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b9c0-577b-4bf8-9fe3-3f2335bf1251 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:48.387763 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b9c0-577b-4bf8-9fe3-3f2335bf1251 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:48.388045 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b9c0-577b-4bf8-9fe3-3f2335bf1251 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:48.388955 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682b9c0-577b-4bf8-9fe3-3f2335bf1251 None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.domain.id=default, user.id=aa8d5e1bfe92436d9d6f59e103786334) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:48.389275 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682b9c0-577b-4bf8-9fe3-3f2335bf1251 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:48.390738 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682b9c0-577b-4bf8-9fe3-3f2335bf1251 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:48.403349 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 30/57] 10.222.0.24 () {56 vars in 1322 bytes} [Wed May 25 13:39:48 2022] GET /identity/v3/role_assignments?user.id=aa8d5e1bfe92436d9d6f59e103786334&scope.domain.id=default&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:50.692195 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0caa4-0bfc-4c53-8f18-3f393d0e5a74 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:50.692733 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0caa4-0bfc-4c53-8f18-3f393d0e5a74 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:50.692733 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0caa4-0bfc-4c53-8f18-3f393d0e5a74 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:50.694120 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 28/58] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:50.699415 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cf893-e1bc-44b7-9e4e-960afe9c382e None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:50.699825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cf893-e1bc-44b7-9e4e-960afe9c382e None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:50.699987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cf893-e1bc-44b7-9e4e-960afe9c382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:50.717215 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-9d6cf893-e1bc-44b7-9e4e-960afe9c382e None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:50.718908 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-9d6cf893-e1bc-44b7-9e4e-960afe9c382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:50.788190 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 31/59] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:39:50.813927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0caa4-0bfc-4c53-8f18-3f393d0e5a74 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:50.829768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:50.917658 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0caa4-0bfc-4c53-8f18-3f393d0e5a74 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:50.950730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f83c7-5589-49e2-ab28-7481cf0e5399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:50.951439 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f83c7-5589-49e2-ab28-7481cf0e5399 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:50.951719 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f83c7-5589-49e2-ab28-7481cf0e5399 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:50.951991 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f83c7-5589-49e2-ab28-7481cf0e5399 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:50.953194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f83c7-5589-49e2-ab28-7481cf0e5399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:50.954805 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f83c7-5589-49e2-ab28-7481cf0e5399 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:50.956462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 29/60] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:39:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:50.961962 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cf893-e1bc-44b7-9e4e-960afe9c382e None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:51.004296 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:51.063144 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cf893-e1bc-44b7-9e4e-960afe9c382e None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:51.096098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882e7ac-61b4-4876-91aa-81c07172c594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:51.096797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882e7ac-61b4-4876-91aa-81c07172c594 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:51.097088 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882e7ac-61b4-4876-91aa-81c07172c594 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:51.097369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882e7ac-61b4-4876-91aa-81c07172c594 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:51.098097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882e7ac-61b4-4876-91aa-81c07172c594 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:51.099552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882e7ac-61b4-4876-91aa-81c07172c594 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:51.124100 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 32/61] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:39:50 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:39:54.227381 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5df88-3e28-4695-9df0-ba3a23c5a557 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:54.228704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5df88-3e28-4695-9df0-ba3a23c5a557 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:54.229189 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5df88-3e28-4695-9df0-ba3a23c5a557 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:54.230751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 30/62] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:54.237120 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a47b32-e0d8-4189-8085-b5740fdeaefc None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:54.238035 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a47b32-e0d8-4189-8085-b5740fdeaefc None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:54.238513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a47b32-e0d8-4189-8085-b5740fdeaefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:54.265222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-f4a47b32-e0d8-4189-8085-b5740fdeaefc None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:54.267096 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-f4a47b32-e0d8-4189-8085-b5740fdeaefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:54.356018 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 33/63] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:39:54.383493 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5df88-3e28-4695-9df0-ba3a23c5a557 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:54.507227 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:54.533744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5df88-3e28-4695-9df0-ba3a23c5a557 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:54.581161 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83a5fe-b5ef-4c9e-b54f-49e3d0b2015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:54.582369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83a5fe-b5ef-4c9e-b54f-49e3d0b2015d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:54.582860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83a5fe-b5ef-4c9e-b54f-49e3d0b2015d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:54.583344 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83a5fe-b5ef-4c9e-b54f-49e3d0b2015d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:54.596291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83a5fe-b5ef-4c9e-b54f-49e3d0b2015d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-6f83a5fe-b5ef-4c9e-b54f-49e3d0b2015d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:39:54.604739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:54.605685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:54.606430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:54.606430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:54.606430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:54.606430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:54.606430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:39:54.606430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:39:54.606430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:39:54.606430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:39:54.606430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:39:54.606430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:39:54.606430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:39:54.606430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:39:54.609126 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 31/64] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:39:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:54.617262 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a47b32-e0d8-4189-8085-b5740fdeaefc None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:54.652668 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:54.775131 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a47b32-e0d8-4189-8085-b5740fdeaefc None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:54.791887 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5101d-e1f7-4e14-95cc-30cd90388438 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:54.792555 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5101d-e1f7-4e14-95cc-30cd90388438 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:54.793039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5101d-e1f7-4e14-95cc-30cd90388438 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:54.794914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 32/65] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:54.800766 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada959ac-0a7b-4fc5-93a9-eff9625336e9 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:54.801362 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada959ac-0a7b-4fc5-93a9-eff9625336e9 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:54.801848 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada959ac-0a7b-4fc5-93a9-eff9625336e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:54.822927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-ada959ac-0a7b-4fc5-93a9-eff9625336e9 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:54.824805 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-ada959ac-0a7b-4fc5-93a9-eff9625336e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:54.842569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238df71c-0527-451b-81db-2f094b6cbdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:54.843411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df71c-0527-451b-81db-2f094b6cbdf1 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:54.843738 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df71c-0527-451b-81db-2f094b6cbdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:54.848728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df71c-0527-451b-81db-2f094b6cbdf1 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:54.848728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238df71c-0527-451b-81db-2f094b6cbdf1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:54.848728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238df71c-0527-451b-81db-2f094b6cbdf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:54.848728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238df71c-0527-451b-81db-2f094b6cbdf1 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:54.865545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 34/66] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:39:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:54.874735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238df71c-0527-451b-81db-2f094b6cbdf1 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:54.965597 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 33/67] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:39:54.992852 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada959ac-0a7b-4fc5-93a9-eff9625336e9 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:55.064753 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:55.077087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238df71c-0527-451b-81db-2f094b6cbdf1 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:55.098800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:55.135745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f299d5-ebaa-40ab-9224-b1564db27e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:55.137032 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f299d5-ebaa-40ab-9224-b1564db27e79 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.137165 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada959ac-0a7b-4fc5-93a9-eff9625336e9 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:55.137649 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f299d5-ebaa-40ab-9224-b1564db27e79 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.138124 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f299d5-ebaa-40ab-9224-b1564db27e79 None admin] PATH_INFO: `/v3/users/688440bc9b9f4620b021702bf9982c66` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.165559 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f299d5-ebaa-40ab-9224-b1564db27e79 None admin] RBAC: Authorizing `identity:get_user(user_id=688440bc9b9f4620b021702bf9982c66)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:55.168182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f299d5-ebaa-40ab-9224-b1564db27e79 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:55.171170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 35/68] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:39:54 2022] GET /identity/v3/users/688440bc9b9f4620b021702bf9982c66 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:55.173273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122beac-3605-4c29-af6d-ab2bbb256854 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.173820 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122beac-3605-4c29-af6d-ab2bbb256854 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.174303 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122beac-3605-4c29-af6d-ab2bbb256854 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.175917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 36/69] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:55.181359 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122beac-3605-4c29-af6d-ab2bbb256854 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:55.188045 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c88491-ae10-41d9-bcf6-c76abd1973ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:55.189234 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c88491-ae10-41d9-bcf6-c76abd1973ec None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.189740 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c88491-ae10-41d9-bcf6-c76abd1973ec None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.190214 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c88491-ae10-41d9-bcf6-c76abd1973ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.206631 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c88491-ae10-41d9-bcf6-c76abd1973ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-56c88491-ae10-41d9-bcf6-c76abd1973ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:39:55.218307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:55.219709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:55.220502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:55.220502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:55.220502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:55.220502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:55.220502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:39:55.220502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:39:55.220502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:39:55.220502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:39:55.220502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:39:55.220502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:39:55.220502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:39:55.220502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:39:55.224072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 34/70] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:39:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:39:55.225513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9f299-871c-4af3-bf22-1d15e746ab3a None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.225973 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9f299-871c-4af3-bf22-1d15e746ab3a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.226399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9f299-871c-4af3-bf22-1d15e746ab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.245314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-9ba9f299-871c-4af3-bf22-1d15e746ab3a None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:55.247631 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-9ba9f299-871c-4af3-bf22-1d15e746ab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:55.294532 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122beac-3605-4c29-af6d-ab2bbb256854 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:55.319802 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 35/71] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:39:55.325493 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a8af3-57f9-4764-bbdc-10f18f34e7c1 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.325789 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a8af3-57f9-4764-bbdc-10f18f34e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.326127 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a8af3-57f9-4764-bbdc-10f18f34e7c1 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.327644 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 36/72] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:55.328912 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a8af3-57f9-4764-bbdc-10f18f34e7c1 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:55.331299 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d98a40-ee6c-4ef2-9a46-3c110a5142d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:55.332344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d98a40-ee6c-4ef2-9a46-3c110a5142d5 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.332820 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d98a40-ee6c-4ef2-9a46-3c110a5142d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.333105 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d98a40-ee6c-4ef2-9a46-3c110a5142d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.354646 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:55.397318 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:55.407946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d98a40-ee6c-4ef2-9a46-3c110a5142d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:55.409482 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d98a40-ee6c-4ef2-9a46-3c110a5142d5 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:55.440948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a8af3-57f9-4764-bbdc-10f18f34e7c1 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:55.476453 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013f34a-d2ca-48ac-ab37-70839bc4354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:55.477140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013f34a-d2ca-48ac-ab37-70839bc4354b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.477429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013f34a-d2ca-48ac-ab37-70839bc4354b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.477717 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013f34a-d2ca-48ac-ab37-70839bc4354b None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.478733 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013f34a-d2ca-48ac-ab37-70839bc4354b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:55.479051 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013f34a-d2ca-48ac-ab37-70839bc4354b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:55.480497 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013f34a-d2ca-48ac-ab37-70839bc4354b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:55.489676 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 37/73] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:39:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:55.491152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75399312-3c3a-4971-bc28-686090261296 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.491454 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75399312-3c3a-4971-bc28-686090261296 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.491737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75399312-3c3a-4971-bc28-686090261296 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.493014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 38/74] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:55.494064 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f704d9f-b5b7-40de-9ef6-f70bac59293b None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.494356 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f704d9f-b5b7-40de-9ef6-f70bac59293b None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.494635 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f704d9f-b5b7-40de-9ef6-f70bac59293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.511295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-1f704d9f-b5b7-40de-9ef6-f70bac59293b None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:55.512568 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-1f704d9f-b5b7-40de-9ef6-f70bac59293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:55.518672 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 37/75] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:39:55.519535 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d98a40-ee6c-4ef2-9a46-3c110a5142d5 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:55.569275 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:55.585726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 39/76] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:39:55.586953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde36f9d-34fc-41c8-9156-5f5d4b633495 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.587242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde36f9d-34fc-41c8-9156-5f5d4b633495 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.587675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde36f9d-34fc-41c8-9156-5f5d4b633495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.618224 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-fde36f9d-34fc-41c8-9156-5f5d4b633495 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:55.619468 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-fde36f9d-34fc-41c8-9156-5f5d4b633495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:55.626127 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d98a40-ee6c-4ef2-9a46-3c110a5142d5 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:55.660700 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d6474-38e9-430e-a126-89bed855e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:55.661494 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d6474-38e9-430e-a126-89bed855e7df None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.661774 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d6474-38e9-430e-a126-89bed855e7df None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.662047 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d6474-38e9-430e-a126-89bed855e7df None admin] PATH_INFO: `/v3/roles/member` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.670846 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:55.674126 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d6474-38e9-430e-a126-89bed855e7df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-505d6474-38e9-430e-a126-89bed855e7df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:39:55.683179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:55.684141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 38/77] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:39:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:55.690367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d6474-38e9-430e-a126-89bed855e7df None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:55.694483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 40/78] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:39:55.695211 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde36f9d-34fc-41c8-9156-5f5d4b633495 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:55.796527 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d6474-38e9-430e-a126-89bed855e7df None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:55.800729 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde36f9d-34fc-41c8-9156-5f5d4b633495 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:55.809822 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:55.839771 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677093a9-93dd-4dcd-865d-5dc7027f75b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:55.840619 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677093a9-93dd-4dcd-865d-5dc7027f75b9 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.840912 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677093a9-93dd-4dcd-865d-5dc7027f75b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.841194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677093a9-93dd-4dcd-865d-5dc7027f75b9 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.842505 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677093a9-93dd-4dcd-865d-5dc7027f75b9 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:55.844787 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677093a9-93dd-4dcd-865d-5dc7027f75b9 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:55.846070 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86452244-1137-4e38-af8b-ce0dc11cd09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:55.846485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 41/79] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:39:55 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:55.846973 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86452244-1137-4e38-af8b-ce0dc11cd09f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.847261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86452244-1137-4e38-af8b-ce0dc11cd09f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.847363 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677093a9-93dd-4dcd-865d-5dc7027f75b9 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:55.847607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86452244-1137-4e38-af8b-ce0dc11cd09f None admin] PATH_INFO: `/v3/users/688440bc9b9f4620b021702bf9982c66` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.848819 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86452244-1137-4e38-af8b-ce0dc11cd09f None admin] RBAC: Authorizing `identity:get_user(user_id=688440bc9b9f4620b021702bf9982c66)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:55.850347 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86452244-1137-4e38-af8b-ce0dc11cd09f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:55.856533 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 39/80] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:39:55 2022] GET /identity/v3/users/688440bc9b9f4620b021702bf9982c66 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:55.856533 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86452244-1137-4e38-af8b-ce0dc11cd09f None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:55.900714 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:55.950707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677093a9-93dd-4dcd-865d-5dc7027f75b9 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:55.958684 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86452244-1137-4e38-af8b-ce0dc11cd09f None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:55.986190 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8416e6-9b50-41c5-9cd1-aae1eb43ebbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:55.986984 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8416e6-9b50-41c5-9cd1-aae1eb43ebbf None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.987267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8416e6-9b50-41c5-9cd1-aae1eb43ebbf None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.987541 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8416e6-9b50-41c5-9cd1-aae1eb43ebbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.993351 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de347a-c017-4407-af27-f0fdf9639472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:55.994020 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de347a-c017-4407-af27-f0fdf9639472 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:55.994314 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de347a-c017-4407-af27-f0fdf9639472 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:55.994589 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de347a-c017-4407-af27-f0fdf9639472 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:55.995343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de347a-c017-4407-af27-f0fdf9639472 None admin] RBAC: Adding query filter params (name=member) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:55.995651 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de347a-c017-4407-af27-f0fdf9639472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:55.997093 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de347a-c017-4407-af27-f0fdf9639472 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:55.997742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8416e6-9b50-41c5-9cd1-aae1eb43ebbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:39:56.005646 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 40/81] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:39:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-bd8416e6-9b50-41c5-9cd1-aae1eb43ebbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:39:56.005790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:56.006607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:56.007369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:56.007369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:56.007369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:56.007369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:56.007369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:39:56.007369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:39:56.007369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:39:56.007369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:39:56.007369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:39:56.007369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:39:56.007369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:39:56.007369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:39:56.007935 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de347a-c017-4407-af27-f0fdf9639472 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:56.008000 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 42/82] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:56.008000 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8416e6-9b50-41c5-9cd1-aae1eb43ebbf None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:56.053574 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:56.116356 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8416e6-9b50-41c5-9cd1-aae1eb43ebbf None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:56.116666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de347a-c017-4407-af27-f0fdf9639472 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:56.127463 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:56.151882 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13ab46-6f6f-45f9-aa9b-d08da0791575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:56.153039 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13ab46-6f6f-45f9-aa9b-d08da0791575 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:56.153337 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13ab46-6f6f-45f9-aa9b-d08da0791575 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:56.153606 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13ab46-6f6f-45f9-aa9b-d08da0791575 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:56.154019 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8b276-25a6-45df-a422-4545762a7186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:56.154896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13ab46-6f6f-45f9-aa9b-d08da0791575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:56.155207 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8b276-25a6-45df-a422-4545762a7186 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:56.155504 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8b276-25a6-45df-a422-4545762a7186 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:56.155792 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8b276-25a6-45df-a422-4545762a7186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:56.157086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13ab46-6f6f-45f9-aa9b-d08da0791575 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:56.157343 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8b276-25a6-45df-a422-4545762a7186 None admin] RBAC: Adding query filter params (role.id=4a110f9a625548a990ed70fad43f73b0, scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0, user.id=688440bc9b9f4620b021702bf9982c66) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:56.157671 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8b276-25a6-45df-a422-4545762a7186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:56.159144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8b276-25a6-45df-a422-4545762a7186 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:56.159399 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 41/83] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:39:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:56.160301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13ab46-6f6f-45f9-aa9b-d08da0791575 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:56.166243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 43/84] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:39:56 2022] GET /identity/v3/role_assignments?user.id=688440bc9b9f4620b021702bf9982c66&scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0&role.id=4a110f9a625548a990ed70fad43f73b0 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:56.167726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8b276-25a6-45df-a422-4545762a7186 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:56.292514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13ab46-6f6f-45f9-aa9b-d08da0791575 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:56.300967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:56.304702 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8b276-25a6-45df-a422-4545762a7186 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:56.334924 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439bb5b-cab9-4f16-b528-fb4cf7bccbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:56.335606 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439bb5b-cab9-4f16-b528-fb4cf7bccbd7 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:56.335897 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439bb5b-cab9-4f16-b528-fb4cf7bccbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:56.336212 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439bb5b-cab9-4f16-b528-fb4cf7bccbd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:56.347420 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26696d2c-a963-4fa5-82df-3ec8f6b07e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:56.348511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26696d2c-a963-4fa5-82df-3ec8f6b07e90 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:56.348813 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26696d2c-a963-4fa5-82df-3ec8f6b07e90 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:56.349098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26696d2c-a963-4fa5-82df-3ec8f6b07e90 None admin] PATH_INFO: `/v3/users/688440bc9b9f4620b021702bf9982c66` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:56.350546 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26696d2c-a963-4fa5-82df-3ec8f6b07e90 None admin] RBAC: Authorizing `identity:get_user(user_id=688440bc9b9f4620b021702bf9982c66)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:56.352266 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26696d2c-a963-4fa5-82df-3ec8f6b07e90 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:56.355214 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 44/85] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:39:56 2022] GET /identity/v3/users/688440bc9b9f4620b021702bf9982c66 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:56.355442 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26696d2c-a963-4fa5-82df-3ec8f6b07e90 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:56.413437 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:56.418433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439bb5b-cab9-4f16-b528-fb4cf7bccbd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:56.419938 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439bb5b-cab9-4f16-b528-fb4cf7bccbd7 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:56.478518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26696d2c-a963-4fa5-82df-3ec8f6b07e90 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:56.522343 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa88f2-e311-4faf-bd33-aa98867d891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:56.523034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa88f2-e311-4faf-bd33-aa98867d891d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:56.523334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa88f2-e311-4faf-bd33-aa98867d891d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:56.523602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa88f2-e311-4faf-bd33-aa98867d891d None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:56.524404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa88f2-e311-4faf-bd33-aa98867d891d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:56.525010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa88f2-e311-4faf-bd33-aa98867d891d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:56.526155 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa88f2-e311-4faf-bd33-aa98867d891d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:56.535464 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 45/86] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:39:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:56.536385 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa88f2-e311-4faf-bd33-aa98867d891d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:56.549540 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 42/87] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:39:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:39:56.549540 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439bb5b-cab9-4f16-b528-fb4cf7bccbd7 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:56.558428 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:56.662387 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa88f2-e311-4faf-bd33-aa98867d891d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:56.663622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439bb5b-cab9-4f16-b528-fb4cf7bccbd7 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:56.666750 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:56.705316 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3e378-2e09-4e05-9d9a-369ead1fdcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:56.706319 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3e378-2e09-4e05-9d9a-369ead1fdcba None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:56.706639 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3e378-2e09-4e05-9d9a-369ead1fdcba None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:56.706996 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3e378-2e09-4e05-9d9a-369ead1fdcba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:56.708509 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64852096-8f03-47d7-8e34-4675c0217007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:56.709226 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64852096-8f03-47d7-8e34-4675c0217007 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:56.709468 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64852096-8f03-47d7-8e34-4675c0217007 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:56.709737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64852096-8f03-47d7-8e34-4675c0217007 None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:56.710683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64852096-8f03-47d7-8e34-4675c0217007 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:56.713122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64852096-8f03-47d7-8e34-4675c0217007 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:56.743270 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 46/88] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:39:56 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:39:56.743270 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64852096-8f03-47d7-8e34-4675c0217007 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:56.796214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3e378-2e09-4e05-9d9a-369ead1fdcba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:56.798975 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3e378-2e09-4e05-9d9a-369ead1fdcba None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:56.809737 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:56.916495 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64852096-8f03-47d7-8e34-4675c0217007 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:56.948777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 43/89] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:39:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:39:56.949597 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3e378-2e09-4e05-9d9a-369ead1fdcba None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:56.968636 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3162d82-b71f-42bf-b1f4-c5dbd6280d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:56.969689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3162d82-b71f-42bf-b1f4-c5dbd6280d60 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:56.969976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3162d82-b71f-42bf-b1f4-c5dbd6280d60 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:56.970798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3162d82-b71f-42bf-b1f4-c5dbd6280d60 None admin] PATH_INFO: `/v3/users/aa8d5e1bfe92436d9d6f59e103786334` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:56.973432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3162d82-b71f-42bf-b1f4-c5dbd6280d60 None admin] RBAC: Authorizing `identity:get_user(user_id=aa8d5e1bfe92436d9d6f59e103786334)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:56.974012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3162d82-b71f-42bf-b1f4-c5dbd6280d60 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:56.976616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 47/90] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:39:56 2022] GET /identity/v3/users/aa8d5e1bfe92436d9d6f59e103786334 => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:56.981945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3162d82-b71f-42bf-b1f4-c5dbd6280d60 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:57.023173 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:57.099941 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3e378-2e09-4e05-9d9a-369ead1fdcba None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:57.111917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:57.133354 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3162d82-b71f-42bf-b1f4-c5dbd6280d60 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:57.148420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b0e6b-a405-41ed-ac9b-f9d06745c1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:57.149852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b0e6b-a405-41ed-ac9b-f9d06745c1c7 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:57.150319 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b0e6b-a405-41ed-ac9b-f9d06745c1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:57.150741 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b0e6b-a405-41ed-ac9b-f9d06745c1c7 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:57.152490 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b0e6b-a405-41ed-ac9b-f9d06745c1c7 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:57.154839 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b0e6b-a405-41ed-ac9b-f9d06745c1c7 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:57.157894 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 44/91] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:39:56 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:57.158492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b0e6b-a405-41ed-ac9b-f9d06745c1c7 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:57.184321 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae16b5-b752-472c-ab19-ccbd01c390c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:57.185120 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae16b5-b752-472c-ab19-ccbd01c390c2 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:57.185407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae16b5-b752-472c-ab19-ccbd01c390c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:57.185679 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae16b5-b752-472c-ab19-ccbd01c390c2 None admin] PATH_INFO: `/v3/projects/0724176f23f04f7995f8548df76d1a63` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:57.187070 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae16b5-b752-472c-ab19-ccbd01c390c2 None admin] RBAC: Authorizing `identity:get_project(project_id=0724176f23f04f7995f8548df76d1a63)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:57.189182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae16b5-b752-472c-ab19-ccbd01c390c2 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:57.191367 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 48/92] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:39:56 2022] GET /identity/v3/projects/0724176f23f04f7995f8548df76d1a63 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:57.192331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae16b5-b752-472c-ab19-ccbd01c390c2 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:57.312880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b0e6b-a405-41ed-ac9b-f9d06745c1c7 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:57.358381 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:57.365871 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae16b5-b752-472c-ab19-ccbd01c390c2 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:57.389423 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a253be-f9ea-4033-aa53-d2397c684d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:57.390452 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a253be-f9ea-4033-aa53-d2397c684d9d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:57.391512 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a253be-f9ea-4033-aa53-d2397c684d9d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:57.392008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a253be-f9ea-4033-aa53-d2397c684d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:57.412827 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0995ede-c28e-49d0-83fc-de393db6b9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:57.413799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0995ede-c28e-49d0-83fc-de393db6b9ee None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:57.414091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0995ede-c28e-49d0-83fc-de393db6b9ee None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:57.414375 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0995ede-c28e-49d0-83fc-de393db6b9ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:57.415250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0995ede-c28e-49d0-83fc-de393db6b9ee None admin] RBAC: Adding query filter params (role.id=97e1bde6953846e0b3e2204a9aa8868d, scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0, user.id=688440bc9b9f4620b021702bf9982c66) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:57.415569 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0995ede-c28e-49d0-83fc-de393db6b9ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:57.417902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0995ede-c28e-49d0-83fc-de393db6b9ee None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:57.429254 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 49/93] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:39:57 2022] GET /identity/v3/role_assignments?user.id=688440bc9b9f4620b021702bf9982c66&scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0&role.id=97e1bde6953846e0b3e2204a9aa8868d => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:57.429254 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0995ede-c28e-49d0-83fc-de393db6b9ee None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:57.474896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:57.553804 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a253be-f9ea-4033-aa53-d2397c684d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:57.556466 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0995ede-c28e-49d0-83fc-de393db6b9ee None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:57.560673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a253be-f9ea-4033-aa53-d2397c684d9d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:57.611394 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eb206-5929-4441-ae5c-f050cac990bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:57.612175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eb206-5929-4441-ae5c-f050cac990bc None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:57.612472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eb206-5929-4441-ae5c-f050cac990bc None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:57.612752 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eb206-5929-4441-ae5c-f050cac990bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:57.613726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933eb206-5929-4441-ae5c-f050cac990bc None admin] RBAC: Adding query filter params (role.id=4a110f9a625548a990ed70fad43f73b0, scope.project.id=0724176f23f04f7995f8548df76d1a63, user.id=688440bc9b9f4620b021702bf9982c66) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:57.614281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933eb206-5929-4441-ae5c-f050cac990bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:57.615833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933eb206-5929-4441-ae5c-f050cac990bc None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:57.623246 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 50/94] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:39:57 2022] GET /identity/v3/role_assignments?user.id=688440bc9b9f4620b021702bf9982c66&scope.project.id=0724176f23f04f7995f8548df76d1a63&role.id=4a110f9a625548a990ed70fad43f73b0 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:57.746830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 45/95] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:39:57.757466 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eb206-5929-4441-ae5c-f050cac990bc None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:57.826050 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:57.936165 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eb206-5929-4441-ae5c-f050cac990bc None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:57.983839 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5703dd0-8fdc-436a-9122-bdb5d5f21596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:57.984948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5703dd0-8fdc-436a-9122-bdb5d5f21596 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:57.985325 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5703dd0-8fdc-436a-9122-bdb5d5f21596 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:57.985612 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5703dd0-8fdc-436a-9122-bdb5d5f21596 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:57.986873 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5703dd0-8fdc-436a-9122-bdb5d5f21596 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:57.988414 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5703dd0-8fdc-436a-9122-bdb5d5f21596 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:57.990190 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 51/96] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:39:57 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:57.996202 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a253be-f9ea-4033-aa53-d2397c684d9d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:58.127390 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:58.161319 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a253be-f9ea-4033-aa53-d2397c684d9d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:58.212984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233b90f-a2e7-4d06-ad12-fe8da0afd95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:58.213704 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233b90f-a2e7-4d06-ad12-fe8da0afd95a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:58.214001 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233b90f-a2e7-4d06-ad12-fe8da0afd95a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:58.214290 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233b90f-a2e7-4d06-ad12-fe8da0afd95a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:58.215535 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233b90f-a2e7-4d06-ad12-fe8da0afd95a None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0, user.id=aa8d5e1bfe92436d9d6f59e103786334) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:58.216140 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233b90f-a2e7-4d06-ad12-fe8da0afd95a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:58.217819 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233b90f-a2e7-4d06-ad12-fe8da0afd95a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:58.229374 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 46/97] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:39:57 2022] GET /identity/v3/role_assignments?user.id=aa8d5e1bfe92436d9d6f59e103786334&scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:59.146101 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f86fea-cf6b-4916-a59d-852e669434ee None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:59.147705 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f86fea-cf6b-4916-a59d-852e669434ee None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:59.148566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f86fea-cf6b-4916-a59d-852e669434ee None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:59.151691 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 52/98] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:39:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:59.172433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39362cb-7943-43e1-ae57-2665a47b531e None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:59.173886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39362cb-7943-43e1-ae57-2665a47b531e None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:59.174715 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39362cb-7943-43e1-ae57-2665a47b531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:59.213349 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-a39362cb-7943-43e1-ae57-2665a47b531e None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:59.216020 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-a39362cb-7943-43e1-ae57-2665a47b531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:59.372720 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 47/99] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:39:59.462431 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f86fea-cf6b-4916-a59d-852e669434ee None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:59.686011 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:59.713289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f86fea-cf6b-4916-a59d-852e669434ee None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:59.798682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785a554-41f9-4abe-8c02-9efd3eb0db08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:59.800174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785a554-41f9-4abe-8c02-9efd3eb0db08 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:59.800693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785a554-41f9-4abe-8c02-9efd3eb0db08 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:59.801198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785a554-41f9-4abe-8c02-9efd3eb0db08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:59.826432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785a554-41f9-4abe-8c02-9efd3eb0db08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-3785a554-41f9-4abe-8c02-9efd3eb0db08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:39:59.843017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:59.844857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:59.845810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:59.845810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:59.845810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:59.845810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:59.845810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:39:59.845810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:39:59.845810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:39:59.845810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:39:59.845810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:39:59.845810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:39:59.845810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:39:59.845810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:39:59.850029 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 53/100] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:39:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:59.859625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39362cb-7943-43e1-ae57-2665a47b531e None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:59.974497 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:00.026410 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39362cb-7943-43e1-ae57-2665a47b531e None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:00.071427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff170c-57ee-414c-ba4e-74b8bf4d11ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:00.072144 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff170c-57ee-414c-ba4e-74b8bf4d11ff None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.072448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff170c-57ee-414c-ba4e-74b8bf4d11ff None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.072735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff170c-57ee-414c-ba4e-74b8bf4d11ff None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.073519 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff170c-57ee-414c-ba4e-74b8bf4d11ff None admin] RBAC: Adding query filter params (name=member) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:00.073836 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff170c-57ee-414c-ba4e-74b8bf4d11ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:00.075238 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff170c-57ee-414c-ba4e-74b8bf4d11ff None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:00.088052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 48/101] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:39:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:00.097240 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785a554-41f9-4abe-8c02-9efd3eb0db08 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:00.302219 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785a554-41f9-4abe-8c02-9efd3eb0db08 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:00.351401 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208c272-a68c-41b5-84a7-f38c1c133fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:00.352385 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208c272-a68c-41b5-84a7-f38c1c133fde None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.352680 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208c272-a68c-41b5-84a7-f38c1c133fde None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.353214 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208c272-a68c-41b5-84a7-f38c1c133fde None admin] PATH_INFO: `/v3/users/688440bc9b9f4620b021702bf9982c66` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.356847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208c272-a68c-41b5-84a7-f38c1c133fde None admin] RBAC: Authorizing `identity:get_user(user_id=688440bc9b9f4620b021702bf9982c66)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:00.358343 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208c272-a68c-41b5-84a7-f38c1c133fde None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:00.360771 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 54/102] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:00 2022] GET /identity/v3/users/688440bc9b9f4620b021702bf9982c66 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:00.366428 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff170c-57ee-414c-ba4e-74b8bf4d11ff None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:00.496749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff170c-57ee-414c-ba4e-74b8bf4d11ff None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:00.540491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:00.549917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551eb9d-597d-4d14-b341-c6d44a1c042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:00.550888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551eb9d-597d-4d14-b341-c6d44a1c042c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.551180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551eb9d-597d-4d14-b341-c6d44a1c042c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.551453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551eb9d-597d-4d14-b341-c6d44a1c042c None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.552869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551eb9d-597d-4d14-b341-c6d44a1c042c None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:00.554546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551eb9d-597d-4d14-b341-c6d44a1c042c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:00.560335 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 49/103] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:00 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:00.563142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208c272-a68c-41b5-84a7-f38c1c133fde None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:00.616525 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:00.751850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208c272-a68c-41b5-84a7-f38c1c133fde None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:00.787315 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214fa8-ed57-45c7-b935-ee82da6b7264 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.787855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214fa8-ed57-45c7-b935-ee82da6b7264 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.788316 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214fa8-ed57-45c7-b935-ee82da6b7264 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.790122 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 50/104] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:00.801288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49502b-2b2b-44d3-a9f8-8a19758bef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:00.801634 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61339a2-c2d5-4e1d-9230-821e07135e6a None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.801927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61339a2-c2d5-4e1d-9230-821e07135e6a None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.802209 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61339a2-c2d5-4e1d-9230-821e07135e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.802972 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49502b-2b2b-44d3-a9f8-8a19758bef76 None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.803407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49502b-2b2b-44d3-a9f8-8a19758bef76 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.803831 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49502b-2b2b-44d3-a9f8-8a19758bef76 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0/users/688440bc9b9f4620b021702bf9982c66/roles/4a110f9a625548a990ed70fad43f73b0` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.806179 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49502b-2b2b-44d3-a9f8-8a19758bef76 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0baa23d9f8e4a49ad2b6910b32414a0, user_id=688440bc9b9f4620b021702bf9982c66, role_id=4a110f9a625548a990ed70fad43f73b0)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:00.807880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49502b-2b2b-44d3-a9f8-8a19758bef76 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:00.824584 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 55/105] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:40:00 2022] PUT /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0/users/688440bc9b9f4620b021702bf9982c66/roles/4a110f9a625548a990ed70fad43f73b0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:00.845561 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-e61339a2-c2d5-4e1d-9230-821e07135e6a None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:00.846797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-e61339a2-c2d5-4e1d-9230-821e07135e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:00.903225 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49bd69-3db6-477c-9f4e-dde6cf46e14b None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.903758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49bd69-3db6-477c-9f4e-dde6cf46e14b None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.904273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49bd69-3db6-477c-9f4e-dde6cf46e14b None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.906437 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 56/106] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:00.913440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf9a21-b77f-4ffc-abc3-28bc4c652bfc None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.914295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf9a21-b77f-4ffc-abc3-28bc4c652bfc None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.914918 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf9a21-b77f-4ffc-abc3-28bc4c652bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.935039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-64cf9a21-b77f-4ffc-abc3-28bc4c652bfc None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:00.936806 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-64cf9a21-b77f-4ffc-abc3-28bc4c652bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:00.966462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 51/107] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:00.968332 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae2391-f4fe-4b4f-9bc3-91a8811f7c94 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.969065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae2391-f4fe-4b4f-9bc3-91a8811f7c94 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.969587 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae2391-f4fe-4b4f-9bc3-91a8811f7c94 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.971497 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 52/108] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:00.972833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9c4df-efa2-4807-9194-8098be040979 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.973383 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9c4df-efa2-4807-9194-8098be040979 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.973884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9c4df-efa2-4807-9194-8098be040979 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.975442 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 53/109] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:00.984527 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1b21e-e7d9-4db3-aa32-7e3eda17ced6 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.985172 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1b21e-e7d9-4db3-aa32-7e3eda17ced6 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.985664 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1b21e-e7d9-4db3-aa32-7e3eda17ced6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:01.007710 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-91a1b21e-e7d9-4db3-aa32-7e3eda17ced6 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:01.008994 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-91a1b21e-e7d9-4db3-aa32-7e3eda17ced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:01.071249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 57/110] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:01.073520 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a5448-0ea7-4432-a05a-93a3e7d1763b None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:01.074041 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a5448-0ea7-4432-a05a-93a3e7d1763b None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:01.074549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a5448-0ea7-4432-a05a-93a3e7d1763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:01.097039 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 54/111] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:01.097346 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-fb2a5448-0ea7-4432-a05a-93a3e7d1763b None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:01.097999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1b21e-e7d9-4db3-aa32-7e3eda17ced6 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:01.098543 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-fb2a5448-0ea7-4432-a05a-93a3e7d1763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:01.117207 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:01.189622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:01.220777 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 58/112] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:01.222270 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a5448-0ea7-4432-a05a-93a3e7d1763b None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:01.249143 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1b21e-e7d9-4db3-aa32-7e3eda17ced6 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:01.290781 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8f031-0ab1-4bdf-bcc6-486ad9eef021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:01.292011 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8f031-0ab1-4bdf-bcc6-486ad9eef021 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:01.292505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8f031-0ab1-4bdf-bcc6-486ad9eef021 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:01.292934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8f031-0ab1-4bdf-bcc6-486ad9eef021 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:01.294676 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8f031-0ab1-4bdf-bcc6-486ad9eef021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:01.296489 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8f031-0ab1-4bdf-bcc6-486ad9eef021 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:01.299143 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 55/113] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:01.300136 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8f031-0ab1-4bdf-bcc6-486ad9eef021 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:01.362713 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a5448-0ea7-4432-a05a-93a3e7d1763b None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:01.403575 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe71ddb-f44f-4b20-bc48-dbc1607b1642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:01.404417 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe71ddb-f44f-4b20-bc48-dbc1607b1642 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:01.404704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe71ddb-f44f-4b20-bc48-dbc1607b1642 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:01.404980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe71ddb-f44f-4b20-bc48-dbc1607b1642 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:01.415340 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:01.420375 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe71ddb-f44f-4b20-bc48-dbc1607b1642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-ffe71ddb-f44f-4b20-bc48-dbc1607b1642 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:01.429956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:01.431093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 59/114] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:01.432018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe71ddb-f44f-4b20-bc48-dbc1607b1642 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:01.437677 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8f031-0ab1-4bdf-bcc6-486ad9eef021 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:01.474353 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:01.486154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf8f99-ae9c-4dc1-88fe-e79c7f5d7421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:01.487357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf8f99-ae9c-4dc1-88fe-e79c7f5d7421 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:01.487968 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf8f99-ae9c-4dc1-88fe-e79c7f5d7421 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:01.488520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf8f99-ae9c-4dc1-88fe-e79c7f5d7421 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:01.501887 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf8f99-ae9c-4dc1-88fe-e79c7f5d7421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-aebf8f99-ae9c-4dc1-88fe-e79c7f5d7421 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:01.511793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:01.512750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:01.513602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:01.513602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:01.513602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:01.513602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:01.513602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:01.513602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:01.513602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:01.513602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:01.513602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:01.513602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:01.513602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:01.513602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:01.516762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 56/115] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:40:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:01.517915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf8f99-ae9c-4dc1-88fe-e79c7f5d7421 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:01.551010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe71ddb-f44f-4b20-bc48-dbc1607b1642 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:01.586901 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cc84f-fcb1-401b-9996-415410f2d43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:01.587922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cc84f-fcb1-401b-9996-415410f2d43b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:01.588032 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cc84f-fcb1-401b-9996-415410f2d43b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:01.588302 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cc84f-fcb1-401b-9996-415410f2d43b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:01.601182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cc84f-fcb1-401b-9996-415410f2d43b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-260cc84f-fcb1-401b-9996-415410f2d43b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:01.609600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:01.610548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:01.611334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 60/116] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:01.612694 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cc84f-fcb1-401b-9996-415410f2d43b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:01.641751 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf8f99-ae9c-4dc1-88fe-e79c7f5d7421 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:01.680003 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a32fd-3c1f-415c-88f3-7533e05e56d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:01.681144 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a32fd-3c1f-415c-88f3-7533e05e56d2 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:01.681701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a32fd-3c1f-415c-88f3-7533e05e56d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:01.682213 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a32fd-3c1f-415c-88f3-7533e05e56d2 None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:01.683176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a32fd-3c1f-415c-88f3-7533e05e56d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:01.685000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a32fd-3c1f-415c-88f3-7533e05e56d2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:01.700990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:01.725575 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 57/117] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:40:01 2022] POST /identity/v3/projects => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:40:01.726749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a32fd-3c1f-415c-88f3-7533e05e56d2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:01.735877 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cc84f-fcb1-401b-9996-415410f2d43b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:01.839320 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334a62-b9a0-476d-b6de-a949af916fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:01.840537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334a62-b9a0-476d-b6de-a949af916fcb None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:01.841036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334a62-b9a0-476d-b6de-a949af916fcb None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:01.841555 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334a62-b9a0-476d-b6de-a949af916fcb None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:01.843237 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334a62-b9a0-476d-b6de-a949af916fcb None admin] RBAC: Adding query filter params (name=reader) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:01.844613 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334a62-b9a0-476d-b6de-a949af916fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:01.847670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334a62-b9a0-476d-b6de-a949af916fcb None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:01.848551 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:01.871773 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 61/118] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:01.880452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334a62-b9a0-476d-b6de-a949af916fcb None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:01.981904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a32fd-3c1f-415c-88f3-7533e05e56d2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:02.030408 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f717a3a-8807-4365-9235-4e2dac2bf1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:02.032289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f717a3a-8807-4365-9235-4e2dac2bf1a7 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:02.032804 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f717a3a-8807-4365-9235-4e2dac2bf1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:02.033333 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f717a3a-8807-4365-9235-4e2dac2bf1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:02.034321 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f717a3a-8807-4365-9235-4e2dac2bf1a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:02.034833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f717a3a-8807-4365-9235-4e2dac2bf1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:02.036715 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f717a3a-8807-4365-9235-4e2dac2bf1a7 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:02.038973 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334a62-b9a0-476d-b6de-a949af916fcb None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:02.046872 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 58/119] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:02.048135 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f717a3a-8807-4365-9235-4e2dac2bf1a7 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:02.063146 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:02.074886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed549d5-ddad-4fa4-9ec9-4bc108226261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:02.075625 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed549d5-ddad-4fa4-9ec9-4bc108226261 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:02.075855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed549d5-ddad-4fa4-9ec9-4bc108226261 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:02.076161 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed549d5-ddad-4fa4-9ec9-4bc108226261 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:02.076971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed549d5-ddad-4fa4-9ec9-4bc108226261 None admin] RBAC: Adding query filter params (name=member) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:02.077298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed549d5-ddad-4fa4-9ec9-4bc108226261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:02.079512 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed549d5-ddad-4fa4-9ec9-4bc108226261 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:02.088209 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 62/120] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:02.089534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf0dac-a6c6-4b71-93db-1a86ab4963de None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:02.089834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf0dac-a6c6-4b71-93db-1a86ab4963de None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:02.090118 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf0dac-a6c6-4b71-93db-1a86ab4963de None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:02.096140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 63/121] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:02.096140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf0dac-a6c6-4b71-93db-1a86ab4963de None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:02.164085 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:02.169350 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f717a3a-8807-4365-9235-4e2dac2bf1a7 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:02.210398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab85458-165c-4f80-a97d-d7c45a1fa043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:02.211767 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab85458-165c-4f80-a97d-d7c45a1fa043 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:02.211996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf0dac-a6c6-4b71-93db-1a86ab4963de None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:02.212673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab85458-165c-4f80-a97d-d7c45a1fa043 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:02.213211 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab85458-165c-4f80-a97d-d7c45a1fa043 None admin] PATH_INFO: `/v3/users/5849db83fdf340f3b56f6db9cb55aef9` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:02.229716 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab85458-165c-4f80-a97d-d7c45a1fa043 None admin] RBAC: Authorizing `identity:get_user(user_id=5849db83fdf340f3b56f6db9cb55aef9)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:02.231732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab85458-165c-4f80-a97d-d7c45a1fa043 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:02.234326 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 59/122] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:02 2022] GET /identity/v3/users/5849db83fdf340f3b56f6db9cb55aef9 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:02.235533 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab85458-165c-4f80-a97d-d7c45a1fa043 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:02.275079 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c54b4-1606-4f8a-95ca-35ce4123d679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:02.276427 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c54b4-1606-4f8a-95ca-35ce4123d679 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:02.277083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c54b4-1606-4f8a-95ca-35ce4123d679 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:02.277583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c54b4-1606-4f8a-95ca-35ce4123d679 None admin] PATH_INFO: `/v3/users/688440bc9b9f4620b021702bf9982c66` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:02.279265 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c54b4-1606-4f8a-95ca-35ce4123d679 None admin] RBAC: Authorizing `identity:get_user(user_id=688440bc9b9f4620b021702bf9982c66)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:02.281186 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c54b4-1606-4f8a-95ca-35ce4123d679 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:02.283386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 64/123] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:02 2022] GET /identity/v3/users/688440bc9b9f4620b021702bf9982c66 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:02.285101 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e4cb9-e0f8-4fe2-9c63-aae6a898ca37 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:02.285645 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e4cb9-e0f8-4fe2-9c63-aae6a898ca37 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:02.286175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e4cb9-e0f8-4fe2-9c63-aae6a898ca37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:02.305846 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-6e5e4cb9-e0f8-4fe2-9c63-aae6a898ca37 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:02.308317 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-6e5e4cb9-e0f8-4fe2-9c63-aae6a898ca37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:02.365441 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab85458-165c-4f80-a97d-d7c45a1fa043 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:02.373322 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:02.404005 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4109c0-75c6-4841-80fe-2660a48a80ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:02.404924 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4109c0-75c6-4841-80fe-2660a48a80ce None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:02.405219 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4109c0-75c6-4841-80fe-2660a48a80ce None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:02.405498 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4109c0-75c6-4841-80fe-2660a48a80ce None admin] PATH_INFO: `/v3/users/688440bc9b9f4620b021702bf9982c66` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:02.406869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4109c0-75c6-4841-80fe-2660a48a80ce None admin] RBAC: Authorizing `identity:get_user(user_id=688440bc9b9f4620b021702bf9982c66)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:02.407934 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 65/124] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:02.413908 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4109c0-75c6-4841-80fe-2660a48a80ce None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:02.413908 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 60/125] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:02 2022] GET /identity/v3/users/688440bc9b9f4620b021702bf9982c66 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:02.413908 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4109c0-75c6-4841-80fe-2660a48a80ce None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:02.415979 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e4cb9-e0f8-4fe2-9c63-aae6a898ca37 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:02.439767 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:02.517292 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4109c0-75c6-4841-80fe-2660a48a80ce None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:02.553194 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332a189-7615-4e8b-9dcb-43ad943c6d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:02.553839 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332a189-7615-4e8b-9dcb-43ad943c6d90 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:02.554135 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332a189-7615-4e8b-9dcb-43ad943c6d90 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:02.554416 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332a189-7615-4e8b-9dcb-43ad943c6d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:02.577469 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e4cb9-e0f8-4fe2-9c63-aae6a898ca37 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:02.617816 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4bd00-2f39-41ff-a335-de4c29bae592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:02.619137 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4bd00-2f39-41ff-a335-de4c29bae592 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:02.619698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4bd00-2f39-41ff-a335-de4c29bae592 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:02.620305 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4bd00-2f39-41ff-a335-de4c29bae592 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:02.621929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4bd00-2f39-41ff-a335-de4c29bae592 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:02.623749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4bd00-2f39-41ff-a335-de4c29bae592 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:02.626471 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 66/126] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:02 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:02.627334 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332a189-7615-4e8b-9dcb-43ad943c6d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:02.627874 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4bd00-2f39-41ff-a335-de4c29bae592 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:02.629225 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332a189-7615-4e8b-9dcb-43ad943c6d90 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:02.660107 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:02.695335 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:02.750936 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 61/127] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:02.751964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332a189-7615-4e8b-9dcb-43ad943c6d90 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:02.781579 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4bd00-2f39-41ff-a335-de4c29bae592 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:02.836233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d503f8f-3975-4361-8453-f17cee94f44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:02.837530 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d503f8f-3975-4361-8453-f17cee94f44f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:02.838108 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d503f8f-3975-4361-8453-f17cee94f44f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:02.838590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d503f8f-3975-4361-8453-f17cee94f44f None admin] PATH_INFO: `/v3/projects/0724176f23f04f7995f8548df76d1a63` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:02.840183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d503f8f-3975-4361-8453-f17cee94f44f None admin] RBAC: Authorizing `identity:get_project(project_id=0724176f23f04f7995f8548df76d1a63)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:02.842140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d503f8f-3975-4361-8453-f17cee94f44f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:02.845090 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 67/128] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:02 2022] GET /identity/v3/projects/0724176f23f04f7995f8548df76d1a63 => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:02.846529 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d503f8f-3975-4361-8453-f17cee94f44f None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:02.863802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332a189-7615-4e8b-9dcb-43ad943c6d90 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:02.891651 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:02.900948 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d761b0-b1cb-4d70-b547-db88beb3513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:02.901747 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d761b0-b1cb-4d70-b547-db88beb3513a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:02.902046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d761b0-b1cb-4d70-b547-db88beb3513a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:02.902328 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d761b0-b1cb-4d70-b547-db88beb3513a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:02.914347 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d761b0-b1cb-4d70-b547-db88beb3513a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-71d761b0-b1cb-4d70-b547-db88beb3513a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:02.922796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:02.923726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:02.924537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:02.924537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:02.924537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:02.924537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:02.924537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:02.924537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:02.924537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:02.924537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:02.924537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:02.924537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:02.924537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:02.924537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:02.928476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 62/129] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:40:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:02.929393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d761b0-b1cb-4d70-b547-db88beb3513a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:02.978047 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d503f8f-3975-4361-8453-f17cee94f44f None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:03.006704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:03.037978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5815c8a-7340-4efe-b454-0beada9d0ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:03.038794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5815c8a-7340-4efe-b454-0beada9d0ada None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.039078 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5815c8a-7340-4efe-b454-0beada9d0ada None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.039355 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5815c8a-7340-4efe-b454-0beada9d0ada None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0/users/688440bc9b9f4620b021702bf9982c66/roles/97e1bde6953846e0b3e2204a9aa8868d` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.042006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5815c8a-7340-4efe-b454-0beada9d0ada None admin] RBAC: Authorizing `identity:create_grant(project_id=c0baa23d9f8e4a49ad2b6910b32414a0, user_id=688440bc9b9f4620b021702bf9982c66, role_id=97e1bde6953846e0b3e2204a9aa8868d)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:03.043488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5815c8a-7340-4efe-b454-0beada9d0ada None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:03.064271 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 68/130] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:40:02 2022] PUT /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0/users/688440bc9b9f4620b021702bf9982c66/roles/97e1bde6953846e0b3e2204a9aa8868d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:03.065322 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5815c8a-7340-4efe-b454-0beada9d0ada None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:03.072425 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d761b0-b1cb-4d70-b547-db88beb3513a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:03.131040 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf14c4-e41d-4a95-b7f3-6b323ffe82a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:03.133129 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf14c4-e41d-4a95-b7f3-6b323ffe82a0 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.134008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf14c4-e41d-4a95-b7f3-6b323ffe82a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.134911 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf14c4-e41d-4a95-b7f3-6b323ffe82a0 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.137476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf14c4-e41d-4a95-b7f3-6b323ffe82a0 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:03.140230 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf14c4-e41d-4a95-b7f3-6b323ffe82a0 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:03.143228 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 63/131] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:02 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:03.144531 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf14c4-e41d-4a95-b7f3-6b323ffe82a0 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:03.183665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5815c8a-7340-4efe-b454-0beada9d0ada None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:03.216638 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:03.224910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde137f-2ca8-4166-b417-507e93ba9b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:03.225841 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde137f-2ca8-4166-b417-507e93ba9b90 None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.226143 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde137f-2ca8-4166-b417-507e93ba9b90 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.226533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde137f-2ca8-4166-b417-507e93ba9b90 None admin] PATH_INFO: `/v3/projects/0724176f23f04f7995f8548df76d1a63/users/688440bc9b9f4620b021702bf9982c66/roles/4a110f9a625548a990ed70fad43f73b0` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.228924 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde137f-2ca8-4166-b417-507e93ba9b90 None admin] RBAC: Authorizing `identity:create_grant(project_id=0724176f23f04f7995f8548df76d1a63, user_id=688440bc9b9f4620b021702bf9982c66, role_id=4a110f9a625548a990ed70fad43f73b0)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:03.230431 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde137f-2ca8-4166-b417-507e93ba9b90 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:03.262658 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 69/132] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:40:03 2022] PUT /identity/v3/projects/0724176f23f04f7995f8548df76d1a63/users/688440bc9b9f4620b021702bf9982c66/roles/4a110f9a625548a990ed70fad43f73b0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:03.263548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde137f-2ca8-4166-b417-507e93ba9b90 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:03.302374 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf14c4-e41d-4a95-b7f3-6b323ffe82a0 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:03.338776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:03.357249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e3264-092b-446c-bc86-4b95a03e8eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:03.358384 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3264-092b-446c-bc86-4b95a03e8eed None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.359530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3264-092b-446c-bc86-4b95a03e8eed None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.360252 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3264-092b-446c-bc86-4b95a03e8eed None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.361288 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e3264-092b-446c-bc86-4b95a03e8eed None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:03.361847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e3264-092b-446c-bc86-4b95a03e8eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:03.363544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e3264-092b-446c-bc86-4b95a03e8eed None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:03.374335 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 64/133] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:03.387921 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e3264-092b-446c-bc86-4b95a03e8eed None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:03.436745 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde137f-2ca8-4166-b417-507e93ba9b90 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:03.480309 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844986d0-6e13-4d85-8258-f7653222c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:03.481126 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844986d0-6e13-4d85-8258-f7653222c482 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.481498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844986d0-6e13-4d85-8258-f7653222c482 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.481883 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844986d0-6e13-4d85-8258-f7653222c482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.482770 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844986d0-6e13-4d85-8258-f7653222c482 None admin] RBAC: Adding query filter params (role.id=ef38bd64ddca4058879ee2f751de5470, scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0, user.id=5849db83fdf340f3b56f6db9cb55aef9) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:03.483203 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844986d0-6e13-4d85-8258-f7653222c482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:03.485842 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844986d0-6e13-4d85-8258-f7653222c482 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:03.492998 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 70/134] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:03 2022] GET /identity/v3/role_assignments?user.id=5849db83fdf340f3b56f6db9cb55aef9&scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0&role.id=ef38bd64ddca4058879ee2f751de5470 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:03.544599 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e3264-092b-446c-bc86-4b95a03e8eed None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:03.568086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:03.600821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5e9bc-1bf0-4663-823c-8c3c5078cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:03.602863 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5e9bc-1bf0-4663-823c-8c3c5078cdcd None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.603562 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5e9bc-1bf0-4663-823c-8c3c5078cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.604242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5e9bc-1bf0-4663-823c-8c3c5078cdcd None admin] PATH_INFO: `/v3/users/aa8d5e1bfe92436d9d6f59e103786334` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.606617 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5e9bc-1bf0-4663-823c-8c3c5078cdcd None admin] RBAC: Authorizing `identity:get_user(user_id=aa8d5e1bfe92436d9d6f59e103786334)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:03.609776 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5e9bc-1bf0-4663-823c-8c3c5078cdcd None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:03.612762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 65/135] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:03 2022] GET /identity/v3/users/aa8d5e1bfe92436d9d6f59e103786334 => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:03.618962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844986d0-6e13-4d85-8258-f7653222c482 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:03.701424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586285f-30a8-438c-ad9b-5f717b4fb658 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.701772 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586285f-30a8-438c-ad9b-5f717b4fb658 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.702005 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586285f-30a8-438c-ad9b-5f717b4fb658 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.704303 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 66/136] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:40:03.724665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239369a-6142-47ba-8eef-800c3399c3ad None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.725023 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239369a-6142-47ba-8eef-800c3399c3ad None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.725240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239369a-6142-47ba-8eef-800c3399c3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.754758 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-8239369a-6142-47ba-8eef-800c3399c3ad None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:03.755979 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-8239369a-6142-47ba-8eef-800c3399c3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:03.831930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844986d0-6e13-4d85-8258-f7653222c482 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:03.834172 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:03.916963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cca59-284d-4883-834a-8643d82a4230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:03.918247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cca59-284d-4883-834a-8643d82a4230 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.918469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 67/137] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:03.919057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cca59-284d-4883-834a-8643d82a4230 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.919648 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cca59-284d-4883-834a-8643d82a4230 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.921352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cca59-284d-4883-834a-8643d82a4230 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:03.923813 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cca59-284d-4883-834a-8643d82a4230 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:03.930557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 71/138] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:03 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:03.936523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239369a-6142-47ba-8eef-800c3399c3ad None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:03.955550 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cca59-284d-4883-834a-8643d82a4230 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:04.152910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cca59-284d-4883-834a-8643d82a4230 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:04.190345 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239369a-6142-47ba-8eef-800c3399c3ad None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:04.240613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:04.242142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76ac45-9c9f-4b03-b0da-141d7ea5418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:04.242973 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76ac45-9c9f-4b03-b0da-141d7ea5418b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:04.243265 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76ac45-9c9f-4b03-b0da-141d7ea5418b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:04.243545 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76ac45-9c9f-4b03-b0da-141d7ea5418b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:04.277123 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76ac45-9c9f-4b03-b0da-141d7ea5418b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-bc76ac45-9c9f-4b03-b0da-141d7ea5418b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:04.294248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:04.295620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:04.297580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 72/139] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:04.305189 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76ac45-9c9f-4b03-b0da-141d7ea5418b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:04.317474 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550a1b7-cfe0-4f02-8dbb-f47cc376965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:04.318460 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550a1b7-cfe0-4f02-8dbb-f47cc376965a None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:04.318750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550a1b7-cfe0-4f02-8dbb-f47cc376965a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:04.319036 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550a1b7-cfe0-4f02-8dbb-f47cc376965a None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0/users/aa8d5e1bfe92436d9d6f59e103786334/roles/109ea861e27e4d75bec3ac9c5f81096e` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:04.325603 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550a1b7-cfe0-4f02-8dbb-f47cc376965a None admin] RBAC: Authorizing `identity:create_grant(project_id=c0baa23d9f8e4a49ad2b6910b32414a0, user_id=aa8d5e1bfe92436d9d6f59e103786334, role_id=109ea861e27e4d75bec3ac9c5f81096e)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:04.327089 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550a1b7-cfe0-4f02-8dbb-f47cc376965a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:04.353464 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 68/140] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:40:03 2022] PUT /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0/users/aa8d5e1bfe92436d9d6f59e103786334/roles/109ea861e27e4d75bec3ac9c5f81096e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:04.381070 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:04.493869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec7143-c8f0-4bd5-91a3-6069e589a818 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:04.494173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec7143-c8f0-4bd5-91a3-6069e589a818 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:04.494358 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec7143-c8f0-4bd5-91a3-6069e589a818 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:04.495753 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 69/141] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:40:04.499981 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76ac45-9c9f-4b03-b0da-141d7ea5418b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:04.501204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ac662-31c0-42ab-b071-060d73b23bba None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:04.501506 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ac662-31c0-42ab-b071-060d73b23bba None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:04.501796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ac662-31c0-42ab-b071-060d73b23bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:04.534011 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-488ac662-31c0-42ab-b071-060d73b23bba None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:04.535249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-488ac662-31c0-42ab-b071-060d73b23bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:04.597716 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25521b1c-7b71-4b07-934a-978619066ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:04.598398 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25521b1c-7b71-4b07-934a-978619066ad6 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:04.598693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25521b1c-7b71-4b07-934a-978619066ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:04.598980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25521b1c-7b71-4b07-934a-978619066ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:04.599745 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25521b1c-7b71-4b07-934a-978619066ad6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:04.600059 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25521b1c-7b71-4b07-934a-978619066ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:04.601577 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25521b1c-7b71-4b07-934a-978619066ad6 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:04.619568 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 73/142] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:04.625859 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25521b1c-7b71-4b07-934a-978619066ad6 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:04.679977 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 70/143] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:04.745801 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ac662-31c0-42ab-b071-060d73b23bba None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:04.811550 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:04.820954 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25521b1c-7b71-4b07-934a-978619066ad6 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:04.862456 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3355e40-a266-4f92-a0cd-e254ff46d1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:04.863574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3355e40-a266-4f92-a0cd-e254ff46d1b6 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:04.864021 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3355e40-a266-4f92-a0cd-e254ff46d1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:04.864461 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3355e40-a266-4f92-a0cd-e254ff46d1b6 None admin] PATH_INFO: `/v3/users/688440bc9b9f4620b021702bf9982c66` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:04.865913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3355e40-a266-4f92-a0cd-e254ff46d1b6 None admin] RBAC: Authorizing `identity:get_user(user_id=688440bc9b9f4620b021702bf9982c66)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:04.867780 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3355e40-a266-4f92-a0cd-e254ff46d1b6 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:04.871970 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 74/144] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:04 2022] GET /identity/v3/users/688440bc9b9f4620b021702bf9982c66 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:04.881301 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3355e40-a266-4f92-a0cd-e254ff46d1b6 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:04.972675 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ac662-31c0-42ab-b071-060d73b23bba None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:04.981812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:05.049236 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebef6e-fbec-45a1-8746-f3059db0aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:05.050324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebef6e-fbec-45a1-8746-f3059db0aeec None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:05.050729 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebef6e-fbec-45a1-8746-f3059db0aeec None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:05.051136 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebef6e-fbec-45a1-8746-f3059db0aeec None admin] PATH_INFO: `/v3/domains/default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:05.053168 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebef6e-fbec-45a1-8746-f3059db0aeec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:05.055411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebef6e-fbec-45a1-8746-f3059db0aeec None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:05.064352 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 71/145] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:05.076576 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebef6e-fbec-45a1-8746-f3059db0aeec None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:05.168912 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3355e40-a266-4f92-a0cd-e254ff46d1b6 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:05.256883 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46115d4f-03ad-437b-b609-8ad3a46f2f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:05.257561 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46115d4f-03ad-437b-b609-8ad3a46f2f44 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:05.257855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46115d4f-03ad-437b-b609-8ad3a46f2f44 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:05.258142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46115d4f-03ad-437b-b609-8ad3a46f2f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:05.307442 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:05.382346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebef6e-fbec-45a1-8746-f3059db0aeec None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:05.385148 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46115d4f-03ad-437b-b609-8ad3a46f2f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:05.386658 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46115d4f-03ad-437b-b609-8ad3a46f2f44 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:05.454539 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be84dbe-9a92-47a7-96e8-6c1341c73a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:05.455567 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be84dbe-9a92-47a7-96e8-6c1341c73a71 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:05.456007 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be84dbe-9a92-47a7-96e8-6c1341c73a71 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:05.456471 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be84dbe-9a92-47a7-96e8-6c1341c73a71 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:05.457561 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be84dbe-9a92-47a7-96e8-6c1341c73a71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:05.459858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be84dbe-9a92-47a7-96e8-6c1341c73a71 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:05.506522 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 72/146] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:40:05 2022] POST /identity/v3/users => generated 283 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:40:05.585426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 75/147] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:05.592406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be84dbe-9a92-47a7-96e8-6c1341c73a71 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:05.637497 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:05.727446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be84dbe-9a92-47a7-96e8-6c1341c73a71 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:05.775592 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b5a5f-e7e9-400d-b88c-098bd36ab822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:05.776552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b5a5f-e7e9-400d-b88c-098bd36ab822 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:05.776849 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b5a5f-e7e9-400d-b88c-098bd36ab822 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:05.777133 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b5a5f-e7e9-400d-b88c-098bd36ab822 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:05.778495 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b5a5f-e7e9-400d-b88c-098bd36ab822 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:05.780005 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b5a5f-e7e9-400d-b88c-098bd36ab822 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:05.782611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 73/148] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:05 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:05.789343 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46115d4f-03ad-437b-b609-8ad3a46f2f44 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:05.922994 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:05.991558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46115d4f-03ad-437b-b609-8ad3a46f2f44 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:06.036717 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16b2ba-2544-474b-be85-054d31cf2d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:06.037380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16b2ba-2544-474b-be85-054d31cf2d49 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:06.037669 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16b2ba-2544-474b-be85-054d31cf2d49 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:06.037949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16b2ba-2544-474b-be85-054d31cf2d49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:06.038802 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16b2ba-2544-474b-be85-054d31cf2d49 None admin] RBAC: Adding query filter params (role.id=4a110f9a625548a990ed70fad43f73b0, scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0, user.id=688440bc9b9f4620b021702bf9982c66) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:06.039118 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16b2ba-2544-474b-be85-054d31cf2d49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:06.040642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16b2ba-2544-474b-be85-054d31cf2d49 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:06.053366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 76/149] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:05 2022] GET /identity/v3/role_assignments?user.id=688440bc9b9f4620b021702bf9982c66&scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0&role.id=4a110f9a625548a990ed70fad43f73b0 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:06.588827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183c6e-bcf8-4c15-b1f1-2486d2478c5b None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:06.589221 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183c6e-bcf8-4c15-b1f1-2486d2478c5b None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:06.589411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183c6e-bcf8-4c15-b1f1-2486d2478c5b None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:06.590836 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 74/150] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:06.597332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cdf5a-d96f-4b2f-89d7-873e3b2b8986 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:06.597982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cdf5a-d96f-4b2f-89d7-873e3b2b8986 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:06.597982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cdf5a-d96f-4b2f-89d7-873e3b2b8986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:06.621968 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-620cdf5a-d96f-4b2f-89d7-873e3b2b8986 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:06.623529 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-620cdf5a-d96f-4b2f-89d7-873e3b2b8986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:06.705960 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 77/151] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:06.732680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66183c6e-bcf8-4c15-b1f1-2486d2478c5b None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:06.806652 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeb583-a971-4fd1-a1dd-5f18fdffe192 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:06.807192 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeb583-a971-4fd1-a1dd-5f18fdffe192 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:06.807576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeb583-a971-4fd1-a1dd-5f18fdffe192 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:06.809506 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 78/152] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:40:06.838100 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f656257-ee99-47c5-96e0-66f4f31c0164 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:06.838396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f656257-ee99-47c5-96e0-66f4f31c0164 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:06.838653 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f656257-ee99-47c5-96e0-66f4f31c0164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:06.871529 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:06.875119 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-1f656257-ee99-47c5-96e0-66f4f31c0164 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:06.876886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-1f656257-ee99-47c5-96e0-66f4f31c0164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:06.887618 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66183c6e-bcf8-4c15-b1f1-2486d2478c5b None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:06.942597 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406eae37-af3a-4212-b18e-acb29cbbe83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:06.943692 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406eae37-af3a-4212-b18e-acb29cbbe83b None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:06.944029 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406eae37-af3a-4212-b18e-acb29cbbe83b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:06.946093 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406eae37-af3a-4212-b18e-acb29cbbe83b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:06.974083 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406eae37-af3a-4212-b18e-acb29cbbe83b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-406eae37-af3a-4212-b18e-acb29cbbe83b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:06.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:06.991633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:06.992455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:06.992455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:06.992455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:06.992455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:06.992455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:06.992455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:06.992455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:06.992455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:06.992455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:06.992455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:06.992455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:06.992455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:06.993848 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 75/153] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:40:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:07.003046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:07.010629 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406eae37-af3a-4212-b18e-acb29cbbe83b None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:07.029379 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 79/154] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:07.069565 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f656257-ee99-47c5-96e0-66f4f31c0164 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:07.235317 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406eae37-af3a-4212-b18e-acb29cbbe83b None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:07.267776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f656257-ee99-47c5-96e0-66f4f31c0164 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:07.290107 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c156a3a-e8b4-4af9-860c-5c56bcfbecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:07.290803 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c156a3a-e8b4-4af9-860c-5c56bcfbecb4 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:07.291091 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c156a3a-e8b4-4af9-860c-5c56bcfbecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:07.291372 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c156a3a-e8b4-4af9-860c-5c56bcfbecb4 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:07.292172 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c156a3a-e8b4-4af9-860c-5c56bcfbecb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:07.292491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c156a3a-e8b4-4af9-860c-5c56bcfbecb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:07.295976 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c156a3a-e8b4-4af9-860c-5c56bcfbecb4 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:07.310522 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 76/155] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:07.312675 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2b938-b260-43af-aa80-d7f7e3e06f03 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:07.312972 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2b938-b260-43af-aa80-d7f7e3e06f03 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:07.313422 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2b938-b260-43af-aa80-d7f7e3e06f03 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:07.315452 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 77/156] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:07.318014 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2b938-b260-43af-aa80-d7f7e3e06f03 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:07.341608 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:07.378690 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24699cf2-e64b-41ef-8a9a-3dd99289b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:07.379501 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24699cf2-e64b-41ef-8a9a-3dd99289b3f9 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:07.379783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24699cf2-e64b-41ef-8a9a-3dd99289b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:07.380134 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24699cf2-e64b-41ef-8a9a-3dd99289b3f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:07.398132 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24699cf2-e64b-41ef-8a9a-3dd99289b3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-24699cf2-e64b-41ef-8a9a-3dd99289b3f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:07.410291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:07.411221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 80/157] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:07.413583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b505a-9efc-4398-aa03-cbf60b1781d2 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:07.415221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b505a-9efc-4398-aa03-cbf60b1781d2 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:07.415221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b505a-9efc-4398-aa03-cbf60b1781d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:07.434656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-920b505a-9efc-4398-aa03-cbf60b1781d2 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:07.436015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-920b505a-9efc-4398-aa03-cbf60b1781d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:07.494008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2b938-b260-43af-aa80-d7f7e3e06f03 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:07.494589 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:07.527794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 81/158] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:07.528522 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b505a-9efc-4398-aa03-cbf60b1781d2 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:07.538305 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bffc87-bac0-4b4c-9252-ee9f6a799fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:07.539196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bffc87-bac0-4b4c-9252-ee9f6a799fa2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:07.539478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bffc87-bac0-4b4c-9252-ee9f6a799fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:07.539755 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bffc87-bac0-4b4c-9252-ee9f6a799fa2 None admin] PATH_INFO: `/v3/users/688440bc9b9f4620b021702bf9982c66` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:07.541037 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bffc87-bac0-4b4c-9252-ee9f6a799fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=688440bc9b9f4620b021702bf9982c66)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:07.542494 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bffc87-bac0-4b4c-9252-ee9f6a799fa2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:07.544462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 78/159] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:07 2022] GET /identity/v3/users/688440bc9b9f4620b021702bf9982c66 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:07.550254 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bffc87-bac0-4b4c-9252-ee9f6a799fa2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:07.681678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:07.694006 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bffc87-bac0-4b4c-9252-ee9f6a799fa2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:07.739252 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382992db-995c-4cf1-a2c5-61ed7e12b748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:07.740037 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382992db-995c-4cf1-a2c5-61ed7e12b748 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:07.740249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382992db-995c-4cf1-a2c5-61ed7e12b748 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:07.740488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382992db-995c-4cf1-a2c5-61ed7e12b748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:07.788489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b505a-9efc-4398-aa03-cbf60b1781d2 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:07.863847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce785c8-b6b8-43d8-ac08-c0f1a9080eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:07.864569 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce785c8-b6b8-43d8-ac08-c0f1a9080eb5 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:07.864852 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce785c8-b6b8-43d8-ac08-c0f1a9080eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:07.865212 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce785c8-b6b8-43d8-ac08-c0f1a9080eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:07.866072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce785c8-b6b8-43d8-ac08-c0f1a9080eb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:07.866292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce785c8-b6b8-43d8-ac08-c0f1a9080eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:07.867718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce785c8-b6b8-43d8-ac08-c0f1a9080eb5 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:07.872442 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382992db-995c-4cf1-a2c5-61ed7e12b748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:07.874018 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382992db-995c-4cf1-a2c5-61ed7e12b748 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:07.879368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 82/160] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:07.880574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce785c8-b6b8-43d8-ac08-c0f1a9080eb5 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:07.960501 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:08.038727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce785c8-b6b8-43d8-ac08-c0f1a9080eb5 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:08.064508 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:08.075222 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fc2bc-7a82-417c-aa18-e11862c6f7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:08.076033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fc2bc-7a82-417c-aa18-e11862c6f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:08.076349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fc2bc-7a82-417c-aa18-e11862c6f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:08.076630 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fc2bc-7a82-417c-aa18-e11862c6f7f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:08.088093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fc2bc-7a82-417c-aa18-e11862c6f7f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-832fc2bc-7a82-417c-aa18-e11862c6f7f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:08.097682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:08.098753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:08.100062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 83/161] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:08.101280 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98209-22c4-49c3-986e-523b8a179022 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:08.101280 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98209-22c4-49c3-986e-523b8a179022 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:08.101407 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 79/162] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:08.101537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98209-22c4-49c3-986e-523b8a179022 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:08.101765 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382992db-995c-4cf1-a2c5-61ed7e12b748 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:08.103288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 84/163] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:08.108194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b98209-22c4-49c3-986e-523b8a179022 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:08.212620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:08.216724 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b98209-22c4-49c3-986e-523b8a179022 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:08.256163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5ebe-7c01-411d-a166-d5672d3f932b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:08.256163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5ebe-7c01-411d-a166-d5672d3f932b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:08.256163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5ebe-7c01-411d-a166-d5672d3f932b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:08.256163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5ebe-7c01-411d-a166-d5672d3f932b None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:08.256558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5ebe-7c01-411d-a166-d5672d3f932b None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:08.257570 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5ebe-7c01-411d-a166-d5672d3f932b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:08.264438 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 85/164] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:08 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:08.264438 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2735e-edcf-4f4b-babd-3aa2b31100bb None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:08.264438 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2735e-edcf-4f4b-babd-3aa2b31100bb None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:08.264438 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2735e-edcf-4f4b-babd-3aa2b31100bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:08.278714 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-77b2735e-edcf-4f4b-babd-3aa2b31100bb None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:08.279926 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-77b2735e-edcf-4f4b-babd-3aa2b31100bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:08.306478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382992db-995c-4cf1-a2c5-61ed7e12b748 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:08.367896 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 86/165] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:08.368805 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2735e-edcf-4f4b-babd-3aa2b31100bb None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:08.386334 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993648d-42bc-4e72-abb1-49643dea807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:08.387547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993648d-42bc-4e72-abb1-49643dea807c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:08.388185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993648d-42bc-4e72-abb1-49643dea807c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:08.388673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993648d-42bc-4e72-abb1-49643dea807c None admin] PATH_INFO: `/v3/users/688440bc9b9f4620b021702bf9982c66` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:08.390700 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993648d-42bc-4e72-abb1-49643dea807c None admin] RBAC: Authorizing `identity:get_user(user_id=688440bc9b9f4620b021702bf9982c66)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:08.392603 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993648d-42bc-4e72-abb1-49643dea807c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:08.395829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 80/166] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:08 2022] GET /identity/v3/users/688440bc9b9f4620b021702bf9982c66 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:08.401554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993648d-42bc-4e72-abb1-49643dea807c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:08.473622 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:08.480823 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2735e-edcf-4f4b-babd-3aa2b31100bb None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:08.517005 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa10cf-da8a-49f9-8f14-c4a99c6b8fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:08.517690 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa10cf-da8a-49f9-8f14-c4a99c6b8fd4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:08.517978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa10cf-da8a-49f9-8f14-c4a99c6b8fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:08.518258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa10cf-da8a-49f9-8f14-c4a99c6b8fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:08.519020 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa10cf-da8a-49f9-8f14-c4a99c6b8fd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:08.519128 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:08.519330 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa10cf-da8a-49f9-8f14-c4a99c6b8fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:08.520768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa10cf-da8a-49f9-8f14-c4a99c6b8fd4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:08.530319 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 87/167] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:08.530319 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa10cf-da8a-49f9-8f14-c4a99c6b8fd4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:08.613356 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993648d-42bc-4e72-abb1-49643dea807c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:08.635131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa10cf-da8a-49f9-8f14-c4a99c6b8fd4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:08.677015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b63e27-86c4-4877-a1d5-4a0f2868fba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:08.677681 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b63e27-86c4-4877-a1d5-4a0f2868fba3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:08.677968 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b63e27-86c4-4877-a1d5-4a0f2868fba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:08.678248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b63e27-86c4-4877-a1d5-4a0f2868fba3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:08.697494 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac2e0a-dcec-4f19-ba83-6c76d0032a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:08.698163 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac2e0a-dcec-4f19-ba83-6c76d0032a84 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:08.698451 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac2e0a-dcec-4f19-ba83-6c76d0032a84 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:08.698731 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac2e0a-dcec-4f19-ba83-6c76d0032a84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:08.699582 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac2e0a-dcec-4f19-ba83-6c76d0032a84 None admin] RBAC: Adding query filter params (role.id=97e1bde6953846e0b3e2204a9aa8868d, scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0, user.id=688440bc9b9f4620b021702bf9982c66) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:08.699898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac2e0a-dcec-4f19-ba83-6c76d0032a84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:08.701394 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac2e0a-dcec-4f19-ba83-6c76d0032a84 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:08.723006 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 81/168] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:08 2022] GET /identity/v3/role_assignments?user.id=688440bc9b9f4620b021702bf9982c66&scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0&role.id=97e1bde6953846e0b3e2204a9aa8868d => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:08.723954 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac2e0a-dcec-4f19-ba83-6c76d0032a84 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:08.730056 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:08.859361 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b63e27-86c4-4877-a1d5-4a0f2868fba3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:08.860955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b63e27-86c4-4877-a1d5-4a0f2868fba3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:08.990934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac2e0a-dcec-4f19-ba83-6c76d0032a84 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:09.027863 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:09.058760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50804e-9ab7-4a9f-b675-0720262692b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:09.059574 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50804e-9ab7-4a9f-b675-0720262692b5 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.059861 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50804e-9ab7-4a9f-b675-0720262692b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.060144 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50804e-9ab7-4a9f-b675-0720262692b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.081164 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 88/169] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:09.081879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b63e27-86c4-4877-a1d5-4a0f2868fba3 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:09.085026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50804e-9ab7-4a9f-b675-0720262692b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-ff50804e-9ab7-4a9f-b675-0720262692b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:09.099760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:09.100749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:09.101554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 82/170] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:40:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:09.102210 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50804e-9ab7-4a9f-b675-0720262692b5 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:09.212434 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:09.241602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50804e-9ab7-4a9f-b675-0720262692b5 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:09.279905 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d631430-6685-41e2-9094-3907ed7f3d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:09.281385 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d631430-6685-41e2-9094-3907ed7f3d5c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.281824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d631430-6685-41e2-9094-3907ed7f3d5c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.282114 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d631430-6685-41e2-9094-3907ed7f3d5c None admin] PATH_INFO: `/v3/projects/0724176f23f04f7995f8548df76d1a63` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.283501 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d631430-6685-41e2-9094-3907ed7f3d5c None admin] RBAC: Authorizing `identity:get_project(project_id=0724176f23f04f7995f8548df76d1a63)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:09.285056 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d631430-6685-41e2-9094-3907ed7f3d5c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:09.287125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 83/171] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:09 2022] GET /identity/v3/projects/0724176f23f04f7995f8548df76d1a63 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:09.287776 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d631430-6685-41e2-9094-3907ed7f3d5c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:09.316259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b63e27-86c4-4877-a1d5-4a0f2868fba3 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:09.354662 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:09.402200 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f663bd-f0ea-4b82-b670-e0fb84539c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:09.403113 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f663bd-f0ea-4b82-b670-e0fb84539c07 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.403398 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f663bd-f0ea-4b82-b670-e0fb84539c07 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.403734 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f663bd-f0ea-4b82-b670-e0fb84539c07 None admin] PATH_INFO: `/v3/users/5849db83fdf340f3b56f6db9cb55aef9` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.403861 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d631430-6685-41e2-9094-3907ed7f3d5c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:09.405094 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f663bd-f0ea-4b82-b670-e0fb84539c07 None admin] RBAC: Authorizing `identity:get_user(user_id=5849db83fdf340f3b56f6db9cb55aef9)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:09.407195 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f663bd-f0ea-4b82-b670-e0fb84539c07 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:09.417673 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 89/172] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:09 2022] GET /identity/v3/users/5849db83fdf340f3b56f6db9cb55aef9 => generated 289 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:09.418578 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f663bd-f0ea-4b82-b670-e0fb84539c07 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:09.441086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af13abd-6b00-4133-b78f-e23176b8827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:09.441782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af13abd-6b00-4133-b78f-e23176b8827d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.442066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af13abd-6b00-4133-b78f-e23176b8827d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.442345 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af13abd-6b00-4133-b78f-e23176b8827d None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.443118 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af13abd-6b00-4133-b78f-e23176b8827d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:09.443427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af13abd-6b00-4133-b78f-e23176b8827d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:09.444857 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af13abd-6b00-4133-b78f-e23176b8827d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:09.455310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 84/173] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:09.455953 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af13abd-6b00-4133-b78f-e23176b8827d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:09.567212 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af13abd-6b00-4133-b78f-e23176b8827d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:09.581932 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:09.605952 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92020e-fb78-47ad-9abf-3a717ff6d9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:09.606834 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92020e-fb78-47ad-9abf-3a717ff6d9c6 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.607125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92020e-fb78-47ad-9abf-3a717ff6d9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.607405 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92020e-fb78-47ad-9abf-3a717ff6d9c6 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.608817 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92020e-fb78-47ad-9abf-3a717ff6d9c6 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:09.610511 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92020e-fb78-47ad-9abf-3a717ff6d9c6 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:09.612615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 85/174] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:09 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:09.613399 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92020e-fb78-47ad-9abf-3a717ff6d9c6 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:09.670370 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f663bd-f0ea-4b82-b670-e0fb84539c07 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:09.707002 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:09.724182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552957f4-ad5f-4b56-9128-435f191eb632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:09.725100 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552957f4-ad5f-4b56-9128-435f191eb632 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.725534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552957f4-ad5f-4b56-9128-435f191eb632 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.725959 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552957f4-ad5f-4b56-9128-435f191eb632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.726999 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552957f4-ad5f-4b56-9128-435f191eb632 None admin] RBAC: Adding query filter params (role.id=4a110f9a625548a990ed70fad43f73b0, scope.project.id=0724176f23f04f7995f8548df76d1a63, user.id=688440bc9b9f4620b021702bf9982c66) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:09.727461 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552957f4-ad5f-4b56-9128-435f191eb632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:09.729491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552957f4-ad5f-4b56-9128-435f191eb632 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:09.739377 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 90/175] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:09 2022] GET /identity/v3/role_assignments?user.id=688440bc9b9f4620b021702bf9982c66&scope.project.id=0724176f23f04f7995f8548df76d1a63&role.id=4a110f9a625548a990ed70fad43f73b0 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:09.740815 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552957f4-ad5f-4b56-9128-435f191eb632 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:09.742305 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92020e-fb78-47ad-9abf-3a717ff6d9c6 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:09.787675 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89acaa-5e3c-48bc-b63c-d9fac6724370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:09.788675 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89acaa-5e3c-48bc-b63c-d9fac6724370 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.788918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89acaa-5e3c-48bc-b63c-d9fac6724370 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.789197 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89acaa-5e3c-48bc-b63c-d9fac6724370 None admin] PATH_INFO: `/v3/users/aa8d5e1bfe92436d9d6f59e103786334` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.790483 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89acaa-5e3c-48bc-b63c-d9fac6724370 None admin] RBAC: Authorizing `identity:get_user(user_id=aa8d5e1bfe92436d9d6f59e103786334)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:09.791939 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89acaa-5e3c-48bc-b63c-d9fac6724370 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:09.793928 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 86/176] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:09 2022] GET /identity/v3/users/aa8d5e1bfe92436d9d6f59e103786334 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:09.795472 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8912aa0-f5f5-4407-8632-550277303f0c None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.795472 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8912aa0-f5f5-4407-8632-550277303f0c None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.795695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8912aa0-f5f5-4407-8632-550277303f0c None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.801797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 87/177] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:09.802496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8912aa0-f5f5-4407-8632-550277303f0c None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:09.868446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:09.894111 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552957f4-ad5f-4b56-9128-435f191eb632 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:09.943168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bee8f-6e1f-401b-8ab1-db98908eddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:09.944782 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bee8f-6e1f-401b-8ab1-db98908eddbf None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.945301 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bee8f-6e1f-401b-8ab1-db98908eddbf None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.945735 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bee8f-6e1f-401b-8ab1-db98908eddbf None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0/users/5849db83fdf340f3b56f6db9cb55aef9/roles/ef38bd64ddca4058879ee2f751de5470` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.948299 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bee8f-6e1f-401b-8ab1-db98908eddbf None admin] RBAC: Authorizing `identity:create_grant(project_id=c0baa23d9f8e4a49ad2b6910b32414a0, user_id=5849db83fdf340f3b56f6db9cb55aef9, role_id=ef38bd64ddca4058879ee2f751de5470)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:09.950122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bee8f-6e1f-401b-8ab1-db98908eddbf None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:09.978957 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 91/178] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:40:09 2022] PUT /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0/users/5849db83fdf340f3b56f6db9cb55aef9/roles/ef38bd64ddca4058879ee2f751de5470 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:09.980663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b24108-ac4e-452f-b9ff-4e98e0171edc None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.981124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b24108-ac4e-452f-b9ff-4e98e0171edc None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.981557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b24108-ac4e-452f-b9ff-4e98e0171edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.011592 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8912aa0-f5f5-4407-8632-550277303f0c None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:10.025516 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-47b24108-ac4e-452f-b9ff-4e98e0171edc None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:10.027143 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-47b24108-ac4e-452f-b9ff-4e98e0171edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:10.060050 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705999b-08c2-459f-ab7b-eb47eaaf0070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:10.060760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705999b-08c2-459f-ab7b-eb47eaaf0070 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.061101 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705999b-08c2-459f-ab7b-eb47eaaf0070 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.062769 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705999b-08c2-459f-ab7b-eb47eaaf0070 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.150650 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:10.186057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 92/179] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:10.188624 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe1499-d6f3-4061-875e-ffb81464d68e None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.188921 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe1499-d6f3-4061-875e-ffb81464d68e None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.189210 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe1499-d6f3-4061-875e-ffb81464d68e None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.190849 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 93/180] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:10.196308 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705999b-08c2-459f-ab7b-eb47eaaf0070 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:10.196652 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1827e-4115-4914-9096-6aa89dba1b38 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.196951 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1827e-4115-4914-9096-6aa89dba1b38 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.197235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1827e-4115-4914-9096-6aa89dba1b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.198880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705999b-08c2-459f-ab7b-eb47eaaf0070 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:10.217349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-1ec1827e-4115-4914-9096-6aa89dba1b38 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:10.218502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-1ec1827e-4115-4914-9096-6aa89dba1b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:10.255372 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:10.298423 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 94/181] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:10.299570 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1827e-4115-4914-9096-6aa89dba1b38 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.336656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 88/182] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:10.338303 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4be25-8ba5-42ec-b123-546c01bd22e8 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.338648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4be25-8ba5-42ec-b123-546c01bd22e8 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.338930 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4be25-8ba5-42ec-b123-546c01bd22e8 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.340431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 89/183] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:10.341071 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4be25-8ba5-42ec-b123-546c01bd22e8 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.411860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1827e-4115-4914-9096-6aa89dba1b38 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:10.423472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:10.451396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba647ee-b0a9-4d9f-aa0c-823f80fae8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:10.452230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba647ee-b0a9-4d9f-aa0c-823f80fae8f2 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.452547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba647ee-b0a9-4d9f-aa0c-823f80fae8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.452842 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba647ee-b0a9-4d9f-aa0c-823f80fae8f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.457010 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4be25-8ba5-42ec-b123-546c01bd22e8 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:10.463717 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba647ee-b0a9-4d9f-aa0c-823f80fae8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-6ba647ee-b0a9-4d9f-aa0c-823f80fae8f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:10.471917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:10.472917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:10.473894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:10.473894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:10.473894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:10.473894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:10.473894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:10.473894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:10.473894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:10.473894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:10.473894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:10.473894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:10.473894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:10.473894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:10.477992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 95/184] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:40:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:10.479299 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ac417-462d-4534-b8b7-041f8642bc03 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.479583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ac417-462d-4534-b8b7-041f8642bc03 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.479910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ac417-462d-4534-b8b7-041f8642bc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.496441 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-fd4ac417-462d-4534-b8b7-041f8642bc03 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:10.497640 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-fd4ac417-462d-4534-b8b7-041f8642bc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:10.498831 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53008032-f0ce-45a4-930f-281908e4921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:10.500918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008032-f0ce-45a4-930f-281908e4921e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.501506 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008032-f0ce-45a4-930f-281908e4921e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.501787 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008032-f0ce-45a4-930f-281908e4921e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.503046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53008032-f0ce-45a4-930f-281908e4921e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:10.504595 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53008032-f0ce-45a4-930f-281908e4921e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:10.506433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 90/185] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:10.512156 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53008032-f0ce-45a4-930f-281908e4921e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.528608 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:10.572714 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 96/186] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:10.577086 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ac417-462d-4534-b8b7-041f8642bc03 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.632765 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53008032-f0ce-45a4-930f-281908e4921e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:10.671010 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f725fb-d14a-4df7-b6e4-469a766a65e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:10.672141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f725fb-d14a-4df7-b6e4-469a766a65e5 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.672489 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f725fb-d14a-4df7-b6e4-469a766a65e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.672767 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f725fb-d14a-4df7-b6e4-469a766a65e5 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.674001 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f725fb-d14a-4df7-b6e4-469a766a65e5 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:10.675448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f725fb-d14a-4df7-b6e4-469a766a65e5 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:10.677331 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 91/187] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:10 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:10.677937 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f725fb-d14a-4df7-b6e4-469a766a65e5 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.689403 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:10.693423 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ac417-462d-4534-b8b7-041f8642bc03 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:10.738985 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e45eb8-b640-4af1-9435-76bdac67f8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:10.740007 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e45eb8-b640-4af1-9435-76bdac67f8cc None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.740510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e45eb8-b640-4af1-9435-76bdac67f8cc None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.740787 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e45eb8-b640-4af1-9435-76bdac67f8cc None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.741562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e45eb8-b640-4af1-9435-76bdac67f8cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:10.741871 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e45eb8-b640-4af1-9435-76bdac67f8cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:10.743289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e45eb8-b640-4af1-9435-76bdac67f8cc None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:10.756992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 97/188] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:10.756992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e45eb8-b640-4af1-9435-76bdac67f8cc None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.786482 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:10.809985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f725fb-d14a-4df7-b6e4-469a766a65e5 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:10.849503 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a66045-fbc4-4fd5-bc27-a8f307545bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:10.850285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66045-fbc4-4fd5-bc27-a8f307545bbd None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.850565 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66045-fbc4-4fd5-bc27-a8f307545bbd None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.850853 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66045-fbc4-4fd5-bc27-a8f307545bbd None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.851571 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a66045-fbc4-4fd5-bc27-a8f307545bbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:10.853550 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a66045-fbc4-4fd5-bc27-a8f307545bbd None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:10.859229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e45eb8-b640-4af1-9435-76bdac67f8cc None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:10.877681 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 92/189] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:40:10 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:40:10.889269 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a66045-fbc4-4fd5-bc27-a8f307545bbd None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.898637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48ca4b-03b3-46f8-a66f-7e83e98bb5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:10.899481 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48ca4b-03b3-46f8-a66f-7e83e98bb5f0 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.899780 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48ca4b-03b3-46f8-a66f-7e83e98bb5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.900040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48ca4b-03b3-46f8-a66f-7e83e98bb5f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.913037 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48ca4b-03b3-46f8-a66f-7e83e98bb5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-0b48ca4b-03b3-46f8-a66f-7e83e98bb5f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:10.928524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:10.929440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 98/190] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:40:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:10.930233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48ca4b-03b3-46f8-a66f-7e83e98bb5f0 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.952622 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:11.028138 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a66045-fbc4-4fd5-bc27-a8f307545bbd None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:11.042559 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48ca4b-03b3-46f8-a66f-7e83e98bb5f0 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:11.070530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85fc13-0a96-4276-8852-3a4dcb846eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:11.071720 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85fc13-0a96-4276-8852-3a4dcb846eec None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:11.072243 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85fc13-0a96-4276-8852-3a4dcb846eec None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:11.072743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85fc13-0a96-4276-8852-3a4dcb846eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:11.073793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85fc13-0a96-4276-8852-3a4dcb846eec None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0, user.id=aa8d5e1bfe92436d9d6f59e103786334) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:11.074180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85fc13-0a96-4276-8852-3a4dcb846eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:11.075635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85fc13-0a96-4276-8852-3a4dcb846eec None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:11.079458 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:11.080939 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac9fa3-3c12-4c43-a364-7664edc8f7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:11.082041 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac9fa3-3c12-4c43-a364-7664edc8f7b8 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:11.082149 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac9fa3-3c12-4c43-a364-7664edc8f7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:11.082423 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac9fa3-3c12-4c43-a364-7664edc8f7b8 None admin] PATH_INFO: `/v3/users/bb92328f4891408cad7424e8af81c03a` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:11.083662 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 93/191] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:10 2022] GET /identity/v3/role_assignments?user.id=aa8d5e1bfe92436d9d6f59e103786334&scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:11.089990 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85fc13-0a96-4276-8852-3a4dcb846eec None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:11.099196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac9fa3-3c12-4c43-a364-7664edc8f7b8 None admin] RBAC: Authorizing `identity:get_user(user_id=bb92328f4891408cad7424e8af81c03a)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:11.100839 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac9fa3-3c12-4c43-a364-7664edc8f7b8 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:11.103335 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 99/192] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:10 2022] GET /identity/v3/users/bb92328f4891408cad7424e8af81c03a => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:11.108285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac9fa3-3c12-4c43-a364-7664edc8f7b8 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:11.208879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:11.238854 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85fc13-0a96-4276-8852-3a4dcb846eec None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:11.239678 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac9fa3-3c12-4c43-a364-7664edc8f7b8 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:11.286588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fdc9a-b387-49b4-aa8f-2729b4c66a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:11.287465 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fdc9a-b387-49b4-aa8f-2729b4c66a20 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:11.287852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fdc9a-b387-49b4-aa8f-2729b4c66a20 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:11.288267 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fdc9a-b387-49b4-aa8f-2729b4c66a20 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:11.289154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fdc9a-b387-49b4-aa8f-2729b4c66a20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:11.289562 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fdc9a-b387-49b4-aa8f-2729b4c66a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:11.291123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fdc9a-b387-49b4-aa8f-2729b4c66a20 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:11.291374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61433df8-a258-45fe-8892-68f1017596b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:11.292282 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61433df8-a258-45fe-8892-68f1017596b2 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:11.292715 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61433df8-a258-45fe-8892-68f1017596b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:11.293498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61433df8-a258-45fe-8892-68f1017596b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:11.303635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 94/193] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:11.309636 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fdc9a-b387-49b4-aa8f-2729b4c66a20 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:11.397100 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:11.408535 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61433df8-a258-45fe-8892-68f1017596b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:11.410023 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61433df8-a258-45fe-8892-68f1017596b2 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:11.445667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fdc9a-b387-49b4-aa8f-2729b4c66a20 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:11.491418 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affdf6f-b121-4ae3-a496-bb6ed9af051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:11.492257 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affdf6f-b121-4ae3-a496-bb6ed9af051c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:11.492544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affdf6f-b121-4ae3-a496-bb6ed9af051c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:11.492823 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affdf6f-b121-4ae3-a496-bb6ed9af051c None admin] PATH_INFO: `/v3/users/bb92328f4891408cad7424e8af81c03a` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:11.494071 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affdf6f-b121-4ae3-a496-bb6ed9af051c None admin] RBAC: Authorizing `identity:get_user(user_id=bb92328f4891408cad7424e8af81c03a)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:11.495551 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affdf6f-b121-4ae3-a496-bb6ed9af051c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:11.497523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 95/194] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:11 2022] GET /identity/v3/users/bb92328f4891408cad7424e8af81c03a => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:11.503261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affdf6f-b121-4ae3-a496-bb6ed9af051c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:11.510018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:11.539492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 100/195] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:40:11.547082 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61433df8-a258-45fe-8892-68f1017596b2 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:11.633863 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affdf6f-b121-4ae3-a496-bb6ed9af051c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:11.659039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61433df8-a258-45fe-8892-68f1017596b2 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:11.668459 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:11.673900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d7529-4e90-4a9d-8385-26c709ca102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:11.674682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d7529-4e90-4a9d-8385-26c709ca102c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:11.674981 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d7529-4e90-4a9d-8385-26c709ca102c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:11.675269 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d7529-4e90-4a9d-8385-26c709ca102c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:11.697022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21469fda-7fb0-4a9b-95aa-79a07d90a75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:11.697901 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21469fda-7fb0-4a9b-95aa-79a07d90a75d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:11.698186 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21469fda-7fb0-4a9b-95aa-79a07d90a75d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:11.698472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21469fda-7fb0-4a9b-95aa-79a07d90a75d None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:11.700232 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21469fda-7fb0-4a9b-95aa-79a07d90a75d None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:11.703663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21469fda-7fb0-4a9b-95aa-79a07d90a75d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:11.708140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 101/196] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:11 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:11.711350 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21469fda-7fb0-4a9b-95aa-79a07d90a75d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:11.757561 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d7529-4e90-4a9d-8385-26c709ca102c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:11.759354 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d7529-4e90-4a9d-8385-26c709ca102c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:11.776018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:11.857714 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21469fda-7fb0-4a9b-95aa-79a07d90a75d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:11.884101 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 96/197] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:40:11.891553 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d7529-4e90-4a9d-8385-26c709ca102c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:11.917913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17ac90-2606-4610-8c1d-308ed015a9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:11.918591 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17ac90-2606-4610-8c1d-308ed015a9c4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:11.918860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17ac90-2606-4610-8c1d-308ed015a9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:11.919134 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17ac90-2606-4610-8c1d-308ed015a9c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:11.920872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17ac90-2606-4610-8c1d-308ed015a9c4 None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc, user.id=bb92328f4891408cad7424e8af81c03a) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:11.921763 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17ac90-2606-4610-8c1d-308ed015a9c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:11.924614 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17ac90-2606-4610-8c1d-308ed015a9c4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:11.942661 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 102/198] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:11 2022] GET /identity/v3/role_assignments?user.id=bb92328f4891408cad7424e8af81c03a&scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:11.978683 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:12.031520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d7529-4e90-4a9d-8385-26c709ca102c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:12.075922 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cc674-acf2-4e4b-9c0e-273c5201e0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:12.076827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cc674-acf2-4e4b-9c0e-273c5201e0b6 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:12.077110 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cc674-acf2-4e4b-9c0e-273c5201e0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:12.077433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cc674-acf2-4e4b-9c0e-273c5201e0b6 None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:12.085178 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cc674-acf2-4e4b-9c0e-273c5201e0b6 None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:12.086679 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cc674-acf2-4e4b-9c0e-273c5201e0b6 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:12.088772 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 97/199] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:11 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:12.095609 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17ac90-2606-4610-8c1d-308ed015a9c4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:12.252354 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17ac90-2606-4610-8c1d-308ed015a9c4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:12.263379 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:12.298352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d0cf9-5d76-449c-9290-7e835a443eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:12.299012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0cf9-5d76-449c-9290-7e835a443eaa None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:12.299300 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0cf9-5d76-449c-9290-7e835a443eaa None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:12.299575 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0cf9-5d76-449c-9290-7e835a443eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:12.300468 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d0cf9-5d76-449c-9290-7e835a443eaa None admin] RBAC: Adding query filter params (role.id=97e1bde6953846e0b3e2204a9aa8868d, scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc, user.id=bb92328f4891408cad7424e8af81c03a) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:12.300786 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d0cf9-5d76-449c-9290-7e835a443eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:12.302273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d0cf9-5d76-449c-9290-7e835a443eaa None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:12.313428 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 103/200] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:12 2022] GET /identity/v3/role_assignments?user.id=bb92328f4891408cad7424e8af81c03a&scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc&role.id=97e1bde6953846e0b3e2204a9aa8868d => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:12.765917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4a556-6fef-4689-8c2e-cf57aa8b8c50 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:12.766215 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4a556-6fef-4689-8c2e-cf57aa8b8c50 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:12.766497 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4a556-6fef-4689-8c2e-cf57aa8b8c50 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:12.768062 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 98/201] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:12.777950 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eec14-db75-42fa-a38c-8b1c4b9d8adb None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:12.778251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eec14-db75-42fa-a38c-8b1c4b9d8adb None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:12.778633 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eec14-db75-42fa-a38c-8b1c4b9d8adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:12.806376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-090eec14-db75-42fa-a38c-8b1c4b9d8adb None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:12.807616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-090eec14-db75-42fa-a38c-8b1c4b9d8adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:12.902184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 104/202] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:12.926223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4a556-6fef-4689-8c2e-cf57aa8b8c50 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:13.058242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:13.065587 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4a556-6fef-4689-8c2e-cf57aa8b8c50 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:13.120072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab75f4-825e-478a-a2ec-3b0b3cb96c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:13.120947 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab75f4-825e-478a-a2ec-3b0b3cb96c62 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:13.121277 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab75f4-825e-478a-a2ec-3b0b3cb96c62 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:13.121538 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab75f4-825e-478a-a2ec-3b0b3cb96c62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:13.140684 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab75f4-825e-478a-a2ec-3b0b3cb96c62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-a8ab75f4-825e-478a-a2ec-3b0b3cb96c62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:13.148874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:13.150900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:13.152435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 99/203] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:13.156529 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eec14-db75-42fa-a38c-8b1c4b9d8adb None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:13.323825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eec14-db75-42fa-a38c-8b1c4b9d8adb None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:13.329125 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:13.381533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338b24e-aac4-4e16-adac-a7a81810c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:13.382324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338b24e-aac4-4e16-adac-a7a81810c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:13.382607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338b24e-aac4-4e16-adac-a7a81810c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:13.382880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338b24e-aac4-4e16-adac-a7a81810c3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:13.383646 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338b24e-aac4-4e16-adac-a7a81810c3b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:13.383950 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338b24e-aac4-4e16-adac-a7a81810c3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:13.385708 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338b24e-aac4-4e16-adac-a7a81810c3b1 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:13.399586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 105/204] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:13.408362 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab75f4-825e-478a-a2ec-3b0b3cb96c62 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:13.527750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab75f4-825e-478a-a2ec-3b0b3cb96c62 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:13.572128 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075591fa-f298-4304-b314-d62374604905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:13.573045 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075591fa-f298-4304-b314-d62374604905 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:13.573337 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075591fa-f298-4304-b314-d62374604905 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:13.573617 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075591fa-f298-4304-b314-d62374604905 None admin] PATH_INFO: `/v3/users/5849db83fdf340f3b56f6db9cb55aef9` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:13.574967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075591fa-f298-4304-b314-d62374604905 None admin] RBAC: Authorizing `identity:get_user(user_id=5849db83fdf340f3b56f6db9cb55aef9)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:13.576428 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075591fa-f298-4304-b314-d62374604905 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:13.578864 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 100/205] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:13 2022] GET /identity/v3/users/5849db83fdf340f3b56f6db9cb55aef9 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:13.584768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338b24e-aac4-4e16-adac-a7a81810c3b1 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:13.716269 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338b24e-aac4-4e16-adac-a7a81810c3b1 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:13.754394 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41de281-cea3-4581-8470-c9cb1b5e5243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:13.755061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de281-cea3-4581-8470-c9cb1b5e5243 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:13.755357 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de281-cea3-4581-8470-c9cb1b5e5243 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:13.755638 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de281-cea3-4581-8470-c9cb1b5e5243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:13.793405 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:13.835742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41de281-cea3-4581-8470-c9cb1b5e5243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:13.837191 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41de281-cea3-4581-8470-c9cb1b5e5243 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:13.952889 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 106/206] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:13.958758 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075591fa-f298-4304-b314-d62374604905 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:13.995048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:14.073503 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075591fa-f298-4304-b314-d62374604905 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:14.110616 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0543fe-2a1a-47b3-8f92-832846b7286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:14.111453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0543fe-2a1a-47b3-8f92-832846b7286b None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.111792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0543fe-2a1a-47b3-8f92-832846b7286b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.112077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0543fe-2a1a-47b3-8f92-832846b7286b None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.113370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0543fe-2a1a-47b3-8f92-832846b7286b None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:14.114827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0543fe-2a1a-47b3-8f92-832846b7286b None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:14.120235 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 101/207] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:13 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:14.122988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41de281-cea3-4581-8470-c9cb1b5e5243 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:14.197938 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:14.238461 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41de281-cea3-4581-8470-c9cb1b5e5243 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:14.274497 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ba752-22a5-4c8a-b63b-fded50bccc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:14.275166 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ba752-22a5-4c8a-b63b-fded50bccc70 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.275455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ba752-22a5-4c8a-b63b-fded50bccc70 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.275733 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ba752-22a5-4c8a-b63b-fded50bccc70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.276618 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ba752-22a5-4c8a-b63b-fded50bccc70 None admin] RBAC: Adding query filter params (role.id=ef38bd64ddca4058879ee2f751de5470, scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0, user.id=5849db83fdf340f3b56f6db9cb55aef9) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:14.276937 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ba752-22a5-4c8a-b63b-fded50bccc70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:14.278413 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ba752-22a5-4c8a-b63b-fded50bccc70 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:14.285374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 107/208] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:14 2022] GET /identity/v3/role_assignments?user.id=5849db83fdf340f3b56f6db9cb55aef9&scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0&role.id=ef38bd64ddca4058879ee2f751de5470 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:14.505175 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c89d7-0082-4f84-af8b-92f780c7e102 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.505544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c89d7-0082-4f84-af8b-92f780c7e102 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.505742 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c89d7-0082-4f84-af8b-92f780c7e102 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.507422 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 102/209] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:14.512460 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0eec6-d670-48bb-aa81-253b538de53b None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.512754 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0eec6-d670-48bb-aa81-253b538de53b None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.513042 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0eec6-d670-48bb-aa81-253b538de53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.535966 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-97a0eec6-d670-48bb-aa81-253b538de53b None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:14.537236 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-97a0eec6-d670-48bb-aa81-253b538de53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:14.615850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 108/210] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:14.640406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c89d7-0082-4f84-af8b-92f780c7e102 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:14.739157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e8823-ac01-42a7-983e-aa4042cb20fd None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.739494 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e8823-ac01-42a7-983e-aa4042cb20fd None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.739730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e8823-ac01-42a7-983e-aa4042cb20fd None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.744757 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 109/211] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:14.746988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b267a0-c637-4700-945f-476311bcfa72 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.748536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b267a0-c637-4700-945f-476311bcfa72 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.748536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b267a0-c637-4700-945f-476311bcfa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.766986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-41b267a0-c637-4700-945f-476311bcfa72 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:14.768203 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-41b267a0-c637-4700-945f-476311bcfa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:14.769449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:14.778092 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c89d7-0082-4f84-af8b-92f780c7e102 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:14.818811 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59766b79-e6cf-4831-95f3-168d637a54c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:14.819620 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59766b79-e6cf-4831-95f3-168d637a54c3 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.819903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59766b79-e6cf-4831-95f3-168d637a54c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.820208 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59766b79-e6cf-4831-95f3-168d637a54c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.837018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:14.841125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59766b79-e6cf-4831-95f3-168d637a54c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-59766b79-e6cf-4831-95f3-168d637a54c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:14.849598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:14.850759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:14.851739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:14.851739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:14.851739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:14.851739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:14.851739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:14.851739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:14.851739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:14.851739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:14.851739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:14.851739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:14.851739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:14.851739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:14.854460 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 103/212] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:14.859384 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 110/213] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:14.860628 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59766b79-e6cf-4831-95f3-168d637a54c3 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:14.875002 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd4c72-f52a-416e-ac1f-95d577ade45c None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.875347 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd4c72-f52a-416e-ac1f-95d577ade45c None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.875634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd4c72-f52a-416e-ac1f-95d577ade45c None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.877677 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 111/214] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:14.882932 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7966ac-20ee-462b-a7cf-3f3f54df60a8 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.883220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7966ac-20ee-462b-a7cf-3f3f54df60a8 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.883489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7966ac-20ee-462b-a7cf-3f3f54df60a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.902133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-2a7966ac-20ee-462b-a7cf-3f3f54df60a8 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:14.903349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-2a7966ac-20ee-462b-a7cf-3f3f54df60a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:14.973784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59766b79-e6cf-4831-95f3-168d637a54c3 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:14.977319 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 112/215] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:14.978352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7966ac-20ee-462b-a7cf-3f3f54df60a8 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.026001 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fae0e-a42a-4175-82ca-458f22d8c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.026588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fae0e-a42a-4175-82ca-458f22d8c33f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.026883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fae0e-a42a-4175-82ca-458f22d8c33f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.027160 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fae0e-a42a-4175-82ca-458f22d8c33f None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.027967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fae0e-a42a-4175-82ca-458f22d8c33f None admin] RBAC: Adding query filter params (name=member) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:15.028330 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fae0e-a42a-4175-82ca-458f22d8c33f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:15.029712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fae0e-a42a-4175-82ca-458f22d8c33f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:15.038168 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 104/216] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:15.041694 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fae0e-a42a-4175-82ca-458f22d8c33f None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.060674 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:15.087498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7966ac-20ee-462b-a7cf-3f3f54df60a8 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:15.110491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:15.129448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9665d-24d2-4764-880e-2012f177a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.130277 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9665d-24d2-4764-880e-2012f177a425 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.130561 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9665d-24d2-4764-880e-2012f177a425 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.130847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9665d-24d2-4764-880e-2012f177a425 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.132165 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9665d-24d2-4764-880e-2012f177a425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:15.133703 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9665d-24d2-4764-880e-2012f177a425 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:15.135804 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 113/217] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:15.136735 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9665d-24d2-4764-880e-2012f177a425 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.161491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fae0e-a42a-4175-82ca-458f22d8c33f None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:15.197662 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883de6ac-8806-4f63-9990-f27472077f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.198917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883de6ac-8806-4f63-9990-f27472077f24 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.199435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883de6ac-8806-4f63-9990-f27472077f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.199915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883de6ac-8806-4f63-9990-f27472077f24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.213617 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883de6ac-8806-4f63-9990-f27472077f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-883de6ac-8806-4f63-9990-f27472077f24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:15.221999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:15.223051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:15.224041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:15.224041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:15.224041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:15.224041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:15.224041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:15.224041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:15.224041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:15.224041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:15.224041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:15.224041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:15.224041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:15.224041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:15.231014 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 105/218] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:40:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:15.231014 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883de6ac-8806-4f63-9990-f27472077f24 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.255791 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9665d-24d2-4764-880e-2012f177a425 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:15.293174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ad7fb-e744-4526-adea-617391979339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.293970 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ad7fb-e744-4526-adea-617391979339 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.294255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ad7fb-e744-4526-adea-617391979339 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.294528 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ad7fb-e744-4526-adea-617391979339 None admin] PATH_INFO: `/v3/users/e59fa90456984e71884a0fad642a875b` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.309397 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ad7fb-e744-4526-adea-617391979339 None admin] RBAC: Authorizing `identity:get_user(user_id=e59fa90456984e71884a0fad642a875b)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:15.310878 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ad7fb-e744-4526-adea-617391979339 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:15.313379 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 114/219] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:15 2022] GET /identity/v3/users/e59fa90456984e71884a0fad642a875b => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:15.314161 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ad7fb-e744-4526-adea-617391979339 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.316215 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:15.340970 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883de6ac-8806-4f63-9990-f27472077f24 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:15.360627 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:15.375708 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27138682-3733-4fe0-af16-8defb1217899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.376439 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27138682-3733-4fe0-af16-8defb1217899 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.376724 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27138682-3733-4fe0-af16-8defb1217899 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.377000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27138682-3733-4fe0-af16-8defb1217899 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.377778 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27138682-3733-4fe0-af16-8defb1217899 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:15.379223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27138682-3733-4fe0-af16-8defb1217899 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:15.398882 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 106/220] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:40:15 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:40:15.400436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759772-e4e0-4d90-974d-92764cf71254 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.400725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759772-e4e0-4d90-974d-92764cf71254 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.401007 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759772-e4e0-4d90-974d-92764cf71254 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.402308 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 107/221] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:15.403061 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a759772-e4e0-4d90-974d-92764cf71254 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.422373 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ad7fb-e744-4526-adea-617391979339 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:15.462194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f796c2-7219-44b8-a192-00f4302c32e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.462867 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f796c2-7219-44b8-a192-00f4302c32e5 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.463155 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f796c2-7219-44b8-a192-00f4302c32e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.463430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f796c2-7219-44b8-a192-00f4302c32e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.464253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f796c2-7219-44b8-a192-00f4302c32e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:15.464575 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f796c2-7219-44b8-a192-00f4302c32e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:15.466012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f796c2-7219-44b8-a192-00f4302c32e5 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:15.475398 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 115/222] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:15.476747 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331c461-b2b1-453e-b147-ac535990aa71 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.477039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331c461-b2b1-453e-b147-ac535990aa71 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.477316 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331c461-b2b1-453e-b147-ac535990aa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.501008 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-0331c461-b2b1-453e-b147-ac535990aa71 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:15.502669 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-0331c461-b2b1-453e-b147-ac535990aa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:15.541175 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a759772-e4e0-4d90-974d-92764cf71254 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:15.576002 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:15.584151 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c285a-1464-428f-8e6e-dc3f68e40f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.584151 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c285a-1464-428f-8e6e-dc3f68e40f9a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.584151 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c285a-1464-428f-8e6e-dc3f68e40f9a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.584483 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c285a-1464-428f-8e6e-dc3f68e40f9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.594942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 116/223] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:15.595650 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331c461-b2b1-453e-b147-ac535990aa71 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.654008 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:15.673692 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c285a-1464-428f-8e6e-dc3f68e40f9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:15.674950 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c285a-1464-428f-8e6e-dc3f68e40f9a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:15.747259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331c461-b2b1-453e-b147-ac535990aa71 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:15.797120 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d594bf-4870-45aa-93fe-8f4de1fe029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.798388 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d594bf-4870-45aa-93fe-8f4de1fe029e None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.798884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d594bf-4870-45aa-93fe-8f4de1fe029e None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.799369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d594bf-4870-45aa-93fe-8f4de1fe029e None admin] PATH_INFO: `/v3/users/bb92328f4891408cad7424e8af81c03a` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.800861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d594bf-4870-45aa-93fe-8f4de1fe029e None admin] RBAC: Authorizing `identity:get_user(user_id=bb92328f4891408cad7424e8af81c03a)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:15.802567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d594bf-4870-45aa-93fe-8f4de1fe029e None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:15.804521 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 117/224] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:15 2022] GET /identity/v3/users/bb92328f4891408cad7424e8af81c03a => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:15.805504 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d594bf-4870-45aa-93fe-8f4de1fe029e None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.824387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 108/225] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:15.825334 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c285a-1464-428f-8e6e-dc3f68e40f9a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.875524 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:15.939641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d594bf-4870-45aa-93fe-8f4de1fe029e None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:15.949762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:15.985824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce38e42-4252-4337-943d-30e290cef595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.987092 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce38e42-4252-4337-943d-30e290cef595 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.987508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce38e42-4252-4337-943d-30e290cef595 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.987937 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce38e42-4252-4337-943d-30e290cef595 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.990041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c285a-1464-428f-8e6e-dc3f68e40f9a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:16.002679 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce38e42-4252-4337-943d-30e290cef595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-4ce38e42-4252-4337-943d-30e290cef595 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:16.014069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:16.015743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 118/226] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:40:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:16.016758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce38e42-4252-4337-943d-30e290cef595 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:16.043427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0dfa0-54ab-4377-af09-29d58a4af0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:16.044326 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0dfa0-54ab-4377-af09-29d58a4af0fc None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:16.044607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0dfa0-54ab-4377-af09-29d58a4af0fc None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:16.044881 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0dfa0-54ab-4377-af09-29d58a4af0fc None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:16.047177 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0dfa0-54ab-4377-af09-29d58a4af0fc None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:16.049223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0dfa0-54ab-4377-af09-29d58a4af0fc None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:16.051709 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 109/227] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:15 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:16.053402 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0dfa0-54ab-4377-af09-29d58a4af0fc None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:16.143578 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce38e42-4252-4337-943d-30e290cef595 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:16.168665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:16.172645 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0dfa0-54ab-4377-af09-29d58a4af0fc None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:16.189843 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085b01d-7d46-46fe-aafd-2f9d13bba149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:16.190868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085b01d-7d46-46fe-aafd-2f9d13bba149 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:16.191155 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085b01d-7d46-46fe-aafd-2f9d13bba149 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:16.191715 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085b01d-7d46-46fe-aafd-2f9d13bba149 None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:16.193743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085b01d-7d46-46fe-aafd-2f9d13bba149 None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:16.195967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085b01d-7d46-46fe-aafd-2f9d13bba149 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:16.200309 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 119/228] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:16 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:16.201221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085b01d-7d46-46fe-aafd-2f9d13bba149 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:16.224685 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c5bfe-7337-4073-b3ff-b612d614820a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:16.225836 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c5bfe-7337-4073-b3ff-b612d614820a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:16.226389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c5bfe-7337-4073-b3ff-b612d614820a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:16.226666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c5bfe-7337-4073-b3ff-b612d614820a None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:16.227846 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c5bfe-7337-4073-b3ff-b612d614820a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:16.228343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c5bfe-7337-4073-b3ff-b612d614820a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:16.230105 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c5bfe-7337-4073-b3ff-b612d614820a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:16.242297 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 110/229] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:16.243202 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c5bfe-7337-4073-b3ff-b612d614820a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:16.250459 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:16.344257 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085b01d-7d46-46fe-aafd-2f9d13bba149 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:16.377008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c5bfe-7337-4073-b3ff-b612d614820a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:16.390352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5488d4-6d34-48b3-a2df-bf1e91eb6e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:16.391693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5488d4-6d34-48b3-a2df-bf1e91eb6e6a None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:16.391976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5488d4-6d34-48b3-a2df-bf1e91eb6e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:16.392729 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5488d4-6d34-48b3-a2df-bf1e91eb6e6a None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc/users/bb92328f4891408cad7424e8af81c03a/roles/109ea861e27e4d75bec3ac9c5f81096e` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:16.395371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5488d4-6d34-48b3-a2df-bf1e91eb6e6a None admin] RBAC: Authorizing `identity:create_grant(project_id=6ad01a9f12cd4be89048efd0d4cd70cc, user_id=bb92328f4891408cad7424e8af81c03a, role_id=109ea861e27e4d75bec3ac9c5f81096e)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:16.397269 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5488d4-6d34-48b3-a2df-bf1e91eb6e6a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:16.416746 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 120/230] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:40:16 2022] PUT /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc/users/bb92328f4891408cad7424e8af81c03a/roles/109ea861e27e4d75bec3ac9c5f81096e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:16.417864 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5488d4-6d34-48b3-a2df-bf1e91eb6e6a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:16.418042 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56407fa1-2f1a-4183-aaab-ca1ba896ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:16.418900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56407fa1-2f1a-4183-aaab-ca1ba896ce99 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:16.419190 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56407fa1-2f1a-4183-aaab-ca1ba896ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:16.419583 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56407fa1-2f1a-4183-aaab-ca1ba896ce99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:16.420621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56407fa1-2f1a-4183-aaab-ca1ba896ce99 None admin] RBAC: Adding query filter params (role.id=4a110f9a625548a990ed70fad43f73b0, scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc, user.id=e59fa90456984e71884a0fad642a875b) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:16.420981 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56407fa1-2f1a-4183-aaab-ca1ba896ce99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:16.422668 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56407fa1-2f1a-4183-aaab-ca1ba896ce99 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:16.429915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 111/231] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:16 2022] GET /identity/v3/role_assignments?user.id=e59fa90456984e71884a0fad642a875b&scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc&role.id=4a110f9a625548a990ed70fad43f73b0 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:16.573499 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:16.584432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5488d4-6d34-48b3-a2df-bf1e91eb6e6a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:16.647898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916d17-dcd8-4bb2-9da3-99a9376a7deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:16.648793 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916d17-dcd8-4bb2-9da3-99a9376a7deb None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:16.649076 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916d17-dcd8-4bb2-9da3-99a9376a7deb None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:16.649350 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916d17-dcd8-4bb2-9da3-99a9376a7deb None admin] PATH_INFO: `/v3/users/bb92328f4891408cad7424e8af81c03a` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:16.650618 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74916d17-dcd8-4bb2-9da3-99a9376a7deb None admin] RBAC: Authorizing `identity:get_user(user_id=bb92328f4891408cad7424e8af81c03a)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:16.652194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74916d17-dcd8-4bb2-9da3-99a9376a7deb None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:16.654165 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 121/232] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:16 2022] GET /identity/v3/users/bb92328f4891408cad7424e8af81c03a => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:16.660958 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56407fa1-2f1a-4183-aaab-ca1ba896ce99 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:16.701002 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:16.802090 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56407fa1-2f1a-4183-aaab-ca1ba896ce99 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:16.843784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86acf4-8476-47ad-9970-08fbeb78b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:16.844746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86acf4-8476-47ad-9970-08fbeb78b937 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:16.845029 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86acf4-8476-47ad-9970-08fbeb78b937 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:16.845307 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86acf4-8476-47ad-9970-08fbeb78b937 None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:16.846734 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86acf4-8476-47ad-9970-08fbeb78b937 None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:16.848283 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86acf4-8476-47ad-9970-08fbeb78b937 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:16.850515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 112/233] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:16 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:16.856968 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916d17-dcd8-4bb2-9da3-99a9376a7deb None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:16.996401 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916d17-dcd8-4bb2-9da3-99a9376a7deb None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:17.044848 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b78aa9-21d8-4f7d-a3ae-cf2dc6bd1521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:17.045806 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b78aa9-21d8-4f7d-a3ae-cf2dc6bd1521 None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:17.046097 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b78aa9-21d8-4f7d-a3ae-cf2dc6bd1521 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:17.046374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b78aa9-21d8-4f7d-a3ae-cf2dc6bd1521 None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc/users/bb92328f4891408cad7424e8af81c03a/roles/97e1bde6953846e0b3e2204a9aa8868d` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:17.048796 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b78aa9-21d8-4f7d-a3ae-cf2dc6bd1521 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ad01a9f12cd4be89048efd0d4cd70cc, user_id=bb92328f4891408cad7424e8af81c03a, role_id=97e1bde6953846e0b3e2204a9aa8868d)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:17.050280 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b78aa9-21d8-4f7d-a3ae-cf2dc6bd1521 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:17.070468 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 122/234] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:40:16 2022] PUT /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc/users/bb92328f4891408cad7424e8af81c03a/roles/97e1bde6953846e0b3e2204a9aa8868d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:18.194781 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef798089-6554-4e60-8b4d-287644d52b7f None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:18.195359 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef798089-6554-4e60-8b4d-287644d52b7f None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:18.195359 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef798089-6554-4e60-8b4d-287644d52b7f None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:18.196749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 113/235] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:18.202709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424eb36-67d5-44b4-9bad-9ab703d7b885 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:18.203545 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424eb36-67d5-44b4-9bad-9ab703d7b885 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:18.204028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424eb36-67d5-44b4-9bad-9ab703d7b885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:18.223159 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-b424eb36-67d5-44b4-9bad-9ab703d7b885 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:18.224764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-b424eb36-67d5-44b4-9bad-9ab703d7b885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:18.244298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:18.269142 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a30d5-26ad-4383-b736-2a21164637bb None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:18.269765 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a30d5-26ad-4383-b736-2a21164637bb None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:18.270248 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a30d5-26ad-4383-b736-2a21164637bb None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:18.273044 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 114/236] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:18.277008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13cf20-38b2-4bab-8bb8-ea5eedc96d1d None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:18.277558 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13cf20-38b2-4bab-8bb8-ea5eedc96d1d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:18.278039 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13cf20-38b2-4bab-8bb8-ea5eedc96d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:18.301100 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 123/237] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:18.309322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-ff13cf20-38b2-4bab-8bb8-ea5eedc96d1d None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:18.310542 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-ff13cf20-38b2-4bab-8bb8-ea5eedc96d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:18.323935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424eb36-67d5-44b4-9bad-9ab703d7b885 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:18.429514 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424eb36-67d5-44b4-9bad-9ab703d7b885 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:18.445999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 115/238] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:18.465263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a0e32-b19d-4955-b5e9-ad3a3c61000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:18.466067 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a0e32-b19d-4955-b5e9-ad3a3c61000d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:18.466350 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a0e32-b19d-4955-b5e9-ad3a3c61000d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:18.466625 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a0e32-b19d-4955-b5e9-ad3a3c61000d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:18.478127 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a0e32-b19d-4955-b5e9-ad3a3c61000d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-c58a0e32-b19d-4955-b5e9-ad3a3c61000d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:18.486202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:18.487081 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:18.488290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 124/239] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:18.491385 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13cf20-38b2-4bab-8bb8-ea5eedc96d1d None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:18.493148 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a0e32-b19d-4955-b5e9-ad3a3c61000d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:18.524465 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:18.544468 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:18.652406 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a0e32-b19d-4955-b5e9-ad3a3c61000d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:18.691048 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0d965-3bc8-4e67-a210-e01f347cc8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:18.691730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d965-3bc8-4e67-a210-e01f347cc8d6 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:18.692016 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d965-3bc8-4e67-a210-e01f347cc8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:18.692345 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d965-3bc8-4e67-a210-e01f347cc8d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:18.693114 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0d965-3bc8-4e67-a210-e01f347cc8d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:18.693425 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0d965-3bc8-4e67-a210-e01f347cc8d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:18.694843 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0d965-3bc8-4e67-a210-e01f347cc8d6 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:18.697221 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13cf20-38b2-4bab-8bb8-ea5eedc96d1d None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:18.704299 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 125/240] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:18.709833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0d965-3bc8-4e67-a210-e01f347cc8d6 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:18.772226 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07c72c-8daf-4fad-ae79-50e9f2c9a22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:18.773034 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07c72c-8daf-4fad-ae79-50e9f2c9a22d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:18.773326 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07c72c-8daf-4fad-ae79-50e9f2c9a22d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:18.773607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07c72c-8daf-4fad-ae79-50e9f2c9a22d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:18.774792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07c72c-8daf-4fad-ae79-50e9f2c9a22d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:18.776284 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07c72c-8daf-4fad-ae79-50e9f2c9a22d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:18.784028 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 116/241] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:18.790333 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07c72c-8daf-4fad-ae79-50e9f2c9a22d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:18.823459 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:18.876776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0d965-3bc8-4e67-a210-e01f347cc8d6 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:18.918640 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce884e1-7d78-4eaf-9e3d-666a1ff6c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:18.919528 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce884e1-7d78-4eaf-9e3d-666a1ff6c679 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:18.919812 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce884e1-7d78-4eaf-9e3d-666a1ff6c679 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:18.920089 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce884e1-7d78-4eaf-9e3d-666a1ff6c679 None admin] PATH_INFO: `/v3/users/1c07bf44e7ef45e0b564831bf35c263b` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:18.949711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce884e1-7d78-4eaf-9e3d-666a1ff6c679 None admin] RBAC: Authorizing `identity:get_user(user_id=1c07bf44e7ef45e0b564831bf35c263b)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:18.951116 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce884e1-7d78-4eaf-9e3d-666a1ff6c679 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:18.953863 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 126/242] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:18 2022] GET /identity/v3/users/1c07bf44e7ef45e0b564831bf35c263b => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:18.961115 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce884e1-7d78-4eaf-9e3d-666a1ff6c679 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:18.984812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:18.999862 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07c72c-8daf-4fad-ae79-50e9f2c9a22d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:19.067027 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce884e1-7d78-4eaf-9e3d-666a1ff6c679 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:19.088311 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08c47-9369-4e0e-bb3b-a01cc16217f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:19.089353 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08c47-9369-4e0e-bb3b-a01cc16217f7 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.089846 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08c47-9369-4e0e-bb3b-a01cc16217f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.090321 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08c47-9369-4e0e-bb3b-a01cc16217f7 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.091271 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08c47-9369-4e0e-bb3b-a01cc16217f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:19.093226 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08c47-9369-4e0e-bb3b-a01cc16217f7 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:19.102832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724d48d-9b28-4f6b-9f7b-3c6b9304b1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:19.103499 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724d48d-9b28-4f6b-9f7b-3c6b9304b1c5 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.103786 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724d48d-9b28-4f6b-9f7b-3c6b9304b1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.104068 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724d48d-9b28-4f6b-9f7b-3c6b9304b1c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.109921 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:19.127701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 117/243] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:40:18 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:40:19.127701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5f4c9-7c83-4f20-a1f8-3b7f7d546977 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.127701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5f4c9-7c83-4f20-a1f8-3b7f7d546977 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.127701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5f4c9-7c83-4f20-a1f8-3b7f7d546977 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.127701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 118/244] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:19.133403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f8e8c-2bb0-4be7-baa8-86458b23d0b2 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.133674 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f8e8c-2bb0-4be7-baa8-86458b23d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.134151 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f8e8c-2bb0-4be7-baa8-86458b23d0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.161244 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-fe6f8e8c-2bb0-4be7-baa8-86458b23d0b2 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:19.163666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-fe6f8e8c-2bb0-4be7-baa8-86458b23d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:19.253542 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724d48d-9b28-4f6b-9f7b-3c6b9304b1c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:19.255918 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724d48d-9b28-4f6b-9f7b-3c6b9304b1c5 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:19.291237 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 119/245] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:19.324074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f8e8c-2bb0-4be7-baa8-86458b23d0b2 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:19.389584 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 127/246] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:19.391699 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724d48d-9b28-4f6b-9f7b-3c6b9304b1c5 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:19.430590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:19.457756 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:19.484422 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f8e8c-2bb0-4be7-baa8-86458b23d0b2 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:19.520628 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724d48d-9b28-4f6b-9f7b-3c6b9304b1c5 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:19.522454 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0292c-2e8e-473f-98e6-79647ba004a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:19.523345 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0292c-2e8e-473f-98e6-79647ba004a9 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.523707 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0292c-2e8e-473f-98e6-79647ba004a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.524142 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0292c-2e8e-473f-98e6-79647ba004a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.536049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0292c-2e8e-473f-98e6-79647ba004a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-9bf0292c-2e8e-473f-98e6-79647ba004a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:19.544170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:19.545232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:19.546272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 120/247] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:19.553248 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0292c-2e8e-473f-98e6-79647ba004a9 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:19.570857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5357-3188-4d6a-9d6e-079d880426bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:19.571745 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5357-3188-4d6a-9d6e-079d880426bd None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.572030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5357-3188-4d6a-9d6e-079d880426bd None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.572351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5357-3188-4d6a-9d6e-079d880426bd None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.573748 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b5357-3188-4d6a-9d6e-079d880426bd None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:19.575315 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b5357-3188-4d6a-9d6e-079d880426bd None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:19.583005 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 128/248] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:19 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:19.583977 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5357-3188-4d6a-9d6e-079d880426bd None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:19.695894 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0292c-2e8e-473f-98e6-79647ba004a9 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:19.702552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5357-3188-4d6a-9d6e-079d880426bd None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:19.711720 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:19.743834 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0f324-7ab2-421f-955a-13e4f891bdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:19.743834 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0f324-7ab2-421f-955a-13e4f891bdbf None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.744104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0f324-7ab2-421f-955a-13e4f891bdbf None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.744381 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0f324-7ab2-421f-955a-13e4f891bdbf None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.747074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0f324-7ab2-421f-955a-13e4f891bdbf None admin] RBAC: Adding query filter params (name=member) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:19.747074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0f324-7ab2-421f-955a-13e4f891bdbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:19.747748 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0f324-7ab2-421f-955a-13e4f891bdbf None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:19.755101 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556824b1-b333-43ae-a24a-7447e28107da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:19.755782 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556824b1-b333-43ae-a24a-7447e28107da None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.756060 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556824b1-b333-43ae-a24a-7447e28107da None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.756385 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:19.756492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556824b1-b333-43ae-a24a-7447e28107da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.757241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556824b1-b333-43ae-a24a-7447e28107da None admin] RBAC: Adding query filter params (role.id=ef38bd64ddca4058879ee2f751de5470, scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc, user.id=1c07bf44e7ef45e0b564831bf35c263b) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:19.757629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556824b1-b333-43ae-a24a-7447e28107da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:19.759379 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556824b1-b333-43ae-a24a-7447e28107da None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:19.761431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 121/249] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:19.766639 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854801b4-95ae-41e2-a830-e34854bf24bc None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.768005 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854801b4-95ae-41e2-a830-e34854bf24bc None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.768889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854801b4-95ae-41e2-a830-e34854bf24bc None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.771014 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 122/250] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:19.771762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854801b4-95ae-41e2-a830-e34854bf24bc None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:19.771885 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 129/251] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:19 2022] GET /identity/v3/role_assignments?user.id=1c07bf44e7ef45e0b564831bf35c263b&scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc&role.id=ef38bd64ddca4058879ee2f751de5470 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:19.777604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b52517-86b7-4e69-9e3b-1dbe3294d48a None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.777887 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b52517-86b7-4e69-9e3b-1dbe3294d48a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.778166 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b52517-86b7-4e69-9e3b-1dbe3294d48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.805981 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-95b52517-86b7-4e69-9e3b-1dbe3294d48a None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:19.807148 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-95b52517-86b7-4e69-9e3b-1dbe3294d48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:19.909926 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 130/252] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:19.931427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854801b4-95ae-41e2-a830-e34854bf24bc None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:19.936568 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b52517-86b7-4e69-9e3b-1dbe3294d48a None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:19.976318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4356f6-c047-41d8-88a7-de1d68947277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:19.977221 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4356f6-c047-41d8-88a7-de1d68947277 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.977753 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4356f6-c047-41d8-88a7-de1d68947277 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.978136 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4356f6-c047-41d8-88a7-de1d68947277 None admin] PATH_INFO: `/v3/users/e59fa90456984e71884a0fad642a875b` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.979563 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4356f6-c047-41d8-88a7-de1d68947277 None admin] RBAC: Authorizing `identity:get_user(user_id=e59fa90456984e71884a0fad642a875b)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:19.981072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4356f6-c047-41d8-88a7-de1d68947277 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:19.983336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 123/253] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:19 2022] GET /identity/v3/users/e59fa90456984e71884a0fad642a875b => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:19.985302 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439e742-0f5e-4b4a-b943-0696ca9a2765 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.985587 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439e742-0f5e-4b4a-b943-0696ca9a2765 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.985860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439e742-0f5e-4b4a-b943-0696ca9a2765 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.987442 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 124/254] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:19.990502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439e742-0f5e-4b4a-b943-0696ca9a2765 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:20.069438 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:20.083233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b52517-86b7-4e69-9e3b-1dbe3294d48a None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:20.116701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:20.157367 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c71e48-4ace-40f4-bbc8-54127844514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:20.158231 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c71e48-4ace-40f4-bbc8-54127844514a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:20.158511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c71e48-4ace-40f4-bbc8-54127844514a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:20.158838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c71e48-4ace-40f4-bbc8-54127844514a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:20.178858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c71e48-4ace-40f4-bbc8-54127844514a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-18c71e48-4ace-40f4-bbc8-54127844514a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:20.187668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:20.188632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:20.189955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 131/255] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:40:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:20.190868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcfe99-7334-4ed8-9889-b6eb94ad527e None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:20.190964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcfe99-7334-4ed8-9889-b6eb94ad527e None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:20.192066 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcfe99-7334-4ed8-9889-b6eb94ad527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:20.192743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439e742-0f5e-4b4a-b943-0696ca9a2765 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:20.219982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-5ebcfe99-7334-4ed8-9889-b6eb94ad527e None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:20.221227 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-5ebcfe99-7334-4ed8-9889-b6eb94ad527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:20.266158 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c4650-c2f3-45e1-b53a-562ab6c02d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:20.267031 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c4650-c2f3-45e1-b53a-562ab6c02d75 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:20.267309 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c4650-c2f3-45e1-b53a-562ab6c02d75 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:20.267578 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c4650-c2f3-45e1-b53a-562ab6c02d75 None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:20.268929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c4650-c2f3-45e1-b53a-562ab6c02d75 None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:20.271550 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c4650-c2f3-45e1-b53a-562ab6c02d75 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:20.275196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 125/256] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:19 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:20.277554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c4650-c2f3-45e1-b53a-562ab6c02d75 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:20.366509 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 132/257] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:20.366509 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcfe99-7334-4ed8-9889-b6eb94ad527e None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:20.442784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c4650-c2f3-45e1-b53a-562ab6c02d75 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:20.482513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642cc9b-252c-4129-b528-15eb3b64acbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:20.483589 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642cc9b-252c-4129-b528-15eb3b64acbf None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:20.484081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642cc9b-252c-4129-b528-15eb3b64acbf None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:20.484506 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:20.484673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642cc9b-252c-4129-b528-15eb3b64acbf None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:20.485563 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642cc9b-252c-4129-b528-15eb3b64acbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:20.486106 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642cc9b-252c-4129-b528-15eb3b64acbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:20.487973 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642cc9b-252c-4129-b528-15eb3b64acbf None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:20.493302 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:20.506745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 126/258] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:20.512840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642cc9b-252c-4129-b528-15eb3b64acbf None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:20.522113 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcfe99-7334-4ed8-9889-b6eb94ad527e None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:20.604850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9e40f-1b50-47dd-b2ee-3ce16a086358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:20.605764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9e40f-1b50-47dd-b2ee-3ce16a086358 None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:20.606041 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9e40f-1b50-47dd-b2ee-3ce16a086358 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:20.606311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9e40f-1b50-47dd-b2ee-3ce16a086358 None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc/users/e59fa90456984e71884a0fad642a875b/roles/4a110f9a625548a990ed70fad43f73b0` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:20.609734 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9e40f-1b50-47dd-b2ee-3ce16a086358 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ad01a9f12cd4be89048efd0d4cd70cc, user_id=e59fa90456984e71884a0fad642a875b, role_id=4a110f9a625548a990ed70fad43f73b0)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:20.611250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9e40f-1b50-47dd-b2ee-3ce16a086358 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:20.638363 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 133/259] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:40:20 2022] PUT /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc/users/e59fa90456984e71884a0fad642a875b/roles/4a110f9a625548a990ed70fad43f73b0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:20.639210 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9e40f-1b50-47dd-b2ee-3ce16a086358 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:20.659676 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642cc9b-252c-4129-b528-15eb3b64acbf None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:20.703662 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f7051-d910-4570-b5d9-5a623e387eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:20.704563 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f7051-d910-4570-b5d9-5a623e387eda None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:20.704855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f7051-d910-4570-b5d9-5a623e387eda None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:20.705136 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f7051-d910-4570-b5d9-5a623e387eda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:20.718076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f7051-d910-4570-b5d9-5a623e387eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-b14f7051-d910-4570-b5d9-5a623e387eda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:20.726555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:20.727806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:20.728746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 127/260] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:40:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:20.739003 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f7051-d910-4570-b5d9-5a623e387eda None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:20.844507 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:20.893779 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f7051-d910-4570-b5d9-5a623e387eda None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:20.902634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9e40f-1b50-47dd-b2ee-3ce16a086358 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:20.933861 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366126d-f3fa-4d41-8d3f-38b40130d9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:20.934673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366126d-f3fa-4d41-8d3f-38b40130d9fd None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:20.934969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366126d-f3fa-4d41-8d3f-38b40130d9fd None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:20.935250 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366126d-f3fa-4d41-8d3f-38b40130d9fd None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:20.936030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366126d-f3fa-4d41-8d3f-38b40130d9fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:20.937042 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366126d-f3fa-4d41-8d3f-38b40130d9fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:20.944145 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366126d-f3fa-4d41-8d3f-38b40130d9fd None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:20.948752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 128/261] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:20.955862 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366126d-f3fa-4d41-8d3f-38b40130d9fd None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:20.985911 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9b66e-0c18-4b0d-bcbd-ff8f6bbaafb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:20.987126 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9b66e-0c18-4b0d-bcbd-ff8f6bbaafb3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:20.987454 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9b66e-0c18-4b0d-bcbd-ff8f6bbaafb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:20.987761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9b66e-0c18-4b0d-bcbd-ff8f6bbaafb3 None admin] PATH_INFO: `/v3/users/bb92328f4891408cad7424e8af81c03a` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:20.989248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9b66e-0c18-4b0d-bcbd-ff8f6bbaafb3 None admin] RBAC: Authorizing `identity:get_user(user_id=bb92328f4891408cad7424e8af81c03a)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:20.990747 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9b66e-0c18-4b0d-bcbd-ff8f6bbaafb3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:20.993311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 134/262] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:20 2022] GET /identity/v3/users/bb92328f4891408cad7424e8af81c03a => generated 283 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:21.001222 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9b66e-0c18-4b0d-bcbd-ff8f6bbaafb3 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:21.029370 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:21.147483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9b66e-0c18-4b0d-bcbd-ff8f6bbaafb3 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:21.202091 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366126d-f3fa-4d41-8d3f-38b40130d9fd None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:21.216587 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16b635-4c2d-433f-84f3-c460687cd827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:21.218158 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16b635-4c2d-433f-84f3-c460687cd827 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:21.218592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16b635-4c2d-433f-84f3-c460687cd827 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:21.219010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16b635-4c2d-433f-84f3-c460687cd827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:21.248909 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:21.289561 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a3521-99d7-4892-aeef-334fbbf7fa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:21.290502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a3521-99d7-4892-aeef-334fbbf7fa80 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:21.290787 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a3521-99d7-4892-aeef-334fbbf7fa80 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:21.291070 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a3521-99d7-4892-aeef-334fbbf7fa80 None admin] PATH_INFO: `/v3/users/bb92328f4891408cad7424e8af81c03a` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:21.292421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a3521-99d7-4892-aeef-334fbbf7fa80 None admin] RBAC: Authorizing `identity:get_user(user_id=bb92328f4891408cad7424e8af81c03a)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:21.294080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a3521-99d7-4892-aeef-334fbbf7fa80 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:21.297255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 129/263] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:20 2022] GET /identity/v3/users/bb92328f4891408cad7424e8af81c03a => generated 283 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:21.307971 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a3521-99d7-4892-aeef-334fbbf7fa80 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:21.358584 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16b635-4c2d-433f-84f3-c460687cd827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:21.361203 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16b635-4c2d-433f-84f3-c460687cd827 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:21.401658 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:21.508188 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 135/264] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:40:21.512314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16b635-4c2d-433f-84f3-c460687cd827 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:21.546486 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a3521-99d7-4892-aeef-334fbbf7fa80 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:21.625192 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a24aa-2614-4b84-b33e-a867173215e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:21.626086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a24aa-2614-4b84-b33e-a867173215e2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:21.626477 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a24aa-2614-4b84-b33e-a867173215e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:21.627226 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a24aa-2614-4b84-b33e-a867173215e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:21.692327 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16b635-4c2d-433f-84f3-c460687cd827 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:21.716576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:21.742250 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:21.755985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a24aa-2614-4b84-b33e-a867173215e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:21.757506 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a24aa-2614-4b84-b33e-a867173215e2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:21.782842 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f746b-e57f-4b1a-987e-ab90c6cd274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:21.783829 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f746b-e57f-4b1a-987e-ab90c6cd274d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:21.784134 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f746b-e57f-4b1a-987e-ab90c6cd274d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:21.784409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f746b-e57f-4b1a-987e-ab90c6cd274d None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:21.788976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f746b-e57f-4b1a-987e-ab90c6cd274d None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:21.790495 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f746b-e57f-4b1a-987e-ab90c6cd274d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:21.796654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 136/265] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:21 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:21.802881 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f746b-e57f-4b1a-987e-ab90c6cd274d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:21.955389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 130/266] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:40:21.960632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a24aa-2614-4b84-b33e-a867173215e2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:21.987552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f746b-e57f-4b1a-987e-ab90c6cd274d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:22.037925 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058bbbd-23d4-4cb2-84bd-667bbadae87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:22.038608 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058bbbd-23d4-4cb2-84bd-667bbadae87a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:22.038893 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058bbbd-23d4-4cb2-84bd-667bbadae87a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:22.039169 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058bbbd-23d4-4cb2-84bd-667bbadae87a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:22.040018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058bbbd-23d4-4cb2-84bd-667bbadae87a None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc, user.id=bb92328f4891408cad7424e8af81c03a) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:22.040362 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058bbbd-23d4-4cb2-84bd-667bbadae87a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:22.041864 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058bbbd-23d4-4cb2-84bd-667bbadae87a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:22.049486 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 137/267] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:21 2022] GET /identity/v3/role_assignments?user.id=bb92328f4891408cad7424e8af81c03a&scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:22.157763 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:22.171265 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a24aa-2614-4b84-b33e-a867173215e2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:22.212801 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdf6dc-48f8-41e3-8faf-ae9ed21f9dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:22.214061 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf6dc-48f8-41e3-8faf-ae9ed21f9dda None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:22.214578 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf6dc-48f8-41e3-8faf-ae9ed21f9dda None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:22.215053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf6dc-48f8-41e3-8faf-ae9ed21f9dda None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:22.221150 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdf6dc-48f8-41e3-8faf-ae9ed21f9dda None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:22.223108 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdf6dc-48f8-41e3-8faf-ae9ed21f9dda None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:22.225677 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 131/268] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:21 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:22.231478 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058bbbd-23d4-4cb2-84bd-667bbadae87a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:22.308554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:22.391018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058bbbd-23d4-4cb2-84bd-667bbadae87a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:22.435772 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8ceac-59c7-4b89-97d4-a16ae157f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:22.437156 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ceac-59c7-4b89-97d4-a16ae157f952 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:22.437485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ceac-59c7-4b89-97d4-a16ae157f952 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:22.437768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ceac-59c7-4b89-97d4-a16ae157f952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:22.438744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ceac-59c7-4b89-97d4-a16ae157f952 None admin] RBAC: Adding query filter params (role.id=97e1bde6953846e0b3e2204a9aa8868d, scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc, user.id=bb92328f4891408cad7424e8af81c03a) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:22.439070 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ceac-59c7-4b89-97d4-a16ae157f952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:22.440711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ceac-59c7-4b89-97d4-a16ae157f952 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:22.449358 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 138/269] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:22 2022] GET /identity/v3/role_assignments?user.id=bb92328f4891408cad7424e8af81c03a&scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc&role.id=97e1bde6953846e0b3e2204a9aa8868d => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:22.815911 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98309e0e-e1c7-48f9-ae3e-53a3456eb15d None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:22.816474 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98309e0e-e1c7-48f9-ae3e-53a3456eb15d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:22.816474 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98309e0e-e1c7-48f9-ae3e-53a3456eb15d None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:22.818333 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 132/270] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:22.823703 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bee0b-965f-49fc-ba5d-c8e1f17409ef None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:22.824003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bee0b-965f-49fc-ba5d-c8e1f17409ef None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:22.824346 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bee0b-965f-49fc-ba5d-c8e1f17409ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:22.849271 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-308bee0b-965f-49fc-ba5d-c8e1f17409ef None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:22.850521 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-308bee0b-965f-49fc-ba5d-c8e1f17409ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:22.941313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 139/271] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:22.972088 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98309e0e-e1c7-48f9-ae3e-53a3456eb15d None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:23.002056 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aaf1e-8f86-41e0-b922-a88c8773d55f None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:23.002440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aaf1e-8f86-41e0-b922-a88c8773d55f None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:23.002675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aaf1e-8f86-41e0-b922-a88c8773d55f None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:23.004536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 140/272] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:40:23.011353 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722450a-3f33-4614-91fc-ad03839eb57f None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:23.012302 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722450a-3f33-4614-91fc-ad03839eb57f None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:23.012593 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722450a-3f33-4614-91fc-ad03839eb57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:23.038265 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-1722450a-3f33-4614-91fc-ad03839eb57f None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:23.039598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-1722450a-3f33-4614-91fc-ad03839eb57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:23.080233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:23.104498 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98309e0e-e1c7-48f9-ae3e-53a3456eb15d None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:23.138386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 141/273] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:23.140861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0f5a5-b8ba-46c2-9d76-4ff5cae5ae0e None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:23.141311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0f5a5-b8ba-46c2-9d76-4ff5cae5ae0e None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:23.141700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0f5a5-b8ba-46c2-9d76-4ff5cae5ae0e None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:23.143486 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 142/274] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:23.148165 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9c2c-ba70-4340-9871-d86d37cc55b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:23.148977 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9c2c-ba70-4340-9871-d86d37cc55b5 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:23.149095 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc269bbd-68f8-44cf-956f-f4bed4d68e22 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:23.149254 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9c2c-ba70-4340-9871-d86d37cc55b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:23.149356 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc269bbd-68f8-44cf-956f-f4bed4d68e22 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:23.149526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9c2c-ba70-4340-9871-d86d37cc55b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:23.149777 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc269bbd-68f8-44cf-956f-f4bed4d68e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:23.150758 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d9c2c-ba70-4340-9871-d86d37cc55b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:23.152826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d9c2c-ba70-4340-9871-d86d37cc55b5 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:23.155556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 133/275] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:23.160641 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9c2c-ba70-4340-9871-d86d37cc55b5 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:23.175052 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-cc269bbd-68f8-44cf-956f-f4bed4d68e22 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:23.176378 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-cc269bbd-68f8-44cf-956f-f4bed4d68e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:23.192762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:23.253723 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 143/276] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:23.253723 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc269bbd-68f8-44cf-956f-f4bed4d68e22 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:23.283802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9c2c-ba70-4340-9871-d86d37cc55b5 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:23.321554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59135a7e-eef1-43c8-bf14-465a600f104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:23.322237 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59135a7e-eef1-43c8-bf14-465a600f104e None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:23.322519 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59135a7e-eef1-43c8-bf14-465a600f104e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:23.322791 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59135a7e-eef1-43c8-bf14-465a600f104e None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:23.323684 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59135a7e-eef1-43c8-bf14-465a600f104e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:23.325156 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59135a7e-eef1-43c8-bf14-465a600f104e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:23.356498 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 134/277] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:40:23 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:40:23.357600 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59135a7e-eef1-43c8-bf14-465a600f104e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:23.370806 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:23.376077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc269bbd-68f8-44cf-956f-f4bed4d68e22 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:23.421810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49ef0c-d325-4e35-9896-87f3dcdc7af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:23.423265 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ef0c-d325-4e35-9896-87f3dcdc7af7 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:23.423880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ef0c-d325-4e35-9896-87f3dcdc7af7 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:23.424417 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ef0c-d325-4e35-9896-87f3dcdc7af7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:23.439260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49ef0c-d325-4e35-9896-87f3dcdc7af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-2c49ef0c-d325-4e35-9896-87f3dcdc7af7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:23.448582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:23.449649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:23.450444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:23.450444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:23.450444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:23.450444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:23.450444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:23.450444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:23.450444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:23.450444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:23.450444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:23.450444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:23.450444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:23.450444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:23.458462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 144/278] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:23.459888 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49ef0c-d325-4e35-9896-87f3dcdc7af7 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:23.492065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:23.524924 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59135a7e-eef1-43c8-bf14-465a600f104e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:23.572950 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fef7d8-d191-4fc0-b11e-1c0c87da48a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:23.575522 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fef7d8-d191-4fc0-b11e-1c0c87da48a0 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:23.576046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fef7d8-d191-4fc0-b11e-1c0c87da48a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:23.576612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fef7d8-d191-4fc0-b11e-1c0c87da48a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:23.589572 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fef7d8-d191-4fc0-b11e-1c0c87da48a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:23.597268 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49ef0c-d325-4e35-9896-87f3dcdc7af7 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-25fef7d8-d191-4fc0-b11e-1c0c87da48a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:23.598161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:23.599065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:23.599851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 135/279] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:23.607427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fef7d8-d191-4fc0-b11e-1c0c87da48a0 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:23.663775 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac84df5-97f3-446e-912c-aec5eeee87b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:23.664915 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac84df5-97f3-446e-912c-aec5eeee87b3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:23.666211 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac84df5-97f3-446e-912c-aec5eeee87b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:23.666683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac84df5-97f3-446e-912c-aec5eeee87b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:23.667619 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac84df5-97f3-446e-912c-aec5eeee87b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:23.668085 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac84df5-97f3-446e-912c-aec5eeee87b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:23.669784 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac84df5-97f3-446e-912c-aec5eeee87b3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:23.684053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 145/280] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:23.690901 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac84df5-97f3-446e-912c-aec5eeee87b3 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:23.720371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:23.758702 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fef7d8-d191-4fc0-b11e-1c0c87da48a0 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:23.801666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e7aef-c8e3-494d-b0c3-b78507e755ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:23.802716 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7aef-c8e3-494d-b0c3-b78507e755ad None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:23.802926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7aef-c8e3-494d-b0c3-b78507e755ad None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:23.803207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7aef-c8e3-494d-b0c3-b78507e755ad None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:23.805691 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e7aef-c8e3-494d-b0c3-b78507e755ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:23.805691 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e7aef-c8e3-494d-b0c3-b78507e755ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:23.807385 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e7aef-c8e3-494d-b0c3-b78507e755ad None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:23.818404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 136/281] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:23.825809 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e7aef-c8e3-494d-b0c3-b78507e755ad None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:23.830239 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:23.838085 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac84df5-97f3-446e-912c-aec5eeee87b3 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:23.878994 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d1883-b58d-447e-b0f6-fd8b09bcac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:23.880410 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d1883-b58d-447e-b0f6-fd8b09bcac27 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:23.880919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d1883-b58d-447e-b0f6-fd8b09bcac27 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:23.881432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d1883-b58d-447e-b0f6-fd8b09bcac27 None admin] PATH_INFO: `/v3/users/9022115caac348f18733a97291721970` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:23.897282 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d1883-b58d-447e-b0f6-fd8b09bcac27 None admin] RBAC: Authorizing `identity:get_user(user_id=9022115caac348f18733a97291721970)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:23.899159 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d1883-b58d-447e-b0f6-fd8b09bcac27 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:23.906667 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 146/282] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:23 2022] GET /identity/v3/users/9022115caac348f18733a97291721970 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:23.908465 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6f08-1afb-45e2-bcab-a93ec6257a61 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:23.909202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6f08-1afb-45e2-bcab-a93ec6257a61 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:23.909687 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6f08-1afb-45e2-bcab-a93ec6257a61 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:23.911616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 147/283] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:23.913156 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6f08-1afb-45e2-bcab-a93ec6257a61 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:23.959618 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e7aef-c8e3-494d-b0c3-b78507e755ad None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:24.006206 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646130f-e661-4741-9c5d-ccd6dc99a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:24.007105 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646130f-e661-4741-9c5d-ccd6dc99a038 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:24.007389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646130f-e661-4741-9c5d-ccd6dc99a038 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:24.007668 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646130f-e661-4741-9c5d-ccd6dc99a038 None admin] PATH_INFO: `/v3/users/1c07bf44e7ef45e0b564831bf35c263b` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:24.009481 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646130f-e661-4741-9c5d-ccd6dc99a038 None admin] RBAC: Authorizing `identity:get_user(user_id=1c07bf44e7ef45e0b564831bf35c263b)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:24.011375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646130f-e661-4741-9c5d-ccd6dc99a038 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:24.013378 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:24.018867 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 137/284] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:23 2022] GET /identity/v3/users/1c07bf44e7ef45e0b564831bf35c263b => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:24.018867 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed2bd8-2130-4208-8966-38d1978d40f6 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:24.018867 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed2bd8-2130-4208-8966-38d1978d40f6 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:24.018867 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed2bd8-2130-4208-8966-38d1978d40f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:24.038868 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-aaed2bd8-2130-4208-8966-38d1978d40f6 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:24.041780 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-aaed2bd8-2130-4208-8966-38d1978d40f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:24.054116 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6f08-1afb-45e2-bcab-a93ec6257a61 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:24.097712 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239e830-9592-4314-a859-846caa4e1858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:24.098797 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239e830-9592-4314-a859-846caa4e1858 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:24.099344 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239e830-9592-4314-a859-846caa4e1858 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:24.099827 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239e830-9592-4314-a859-846caa4e1858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:24.100964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239e830-9592-4314-a859-846caa4e1858 None admin] RBAC: Adding query filter params (role.id=4a110f9a625548a990ed70fad43f73b0, user.id=9022115caac348f18733a97291721970, scope.system=all) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:24.101519 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239e830-9592-4314-a859-846caa4e1858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:24.103552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239e830-9592-4314-a859-846caa4e1858 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:24.116288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 148/285] 10.222.0.24 () {56 vars in 1308 bytes} [Wed May 25 13:40:23 2022] GET /identity/v3/role_assignments?user.id=9022115caac348f18733a97291721970&scope.system=all&role.id=4a110f9a625548a990ed70fad43f73b0 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:24.117684 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239e830-9592-4314-a859-846caa4e1858 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:24.127367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:24.134316 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 138/286] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:24.164878 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed2bd8-2130-4208-8966-38d1978d40f6 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:24.349798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239e830-9592-4314-a859-846caa4e1858 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:24.360512 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed2bd8-2130-4208-8966-38d1978d40f6 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:24.414904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c2b3-3e7d-44d2-a70c-e019bdfabdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:24.416009 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c2b3-3e7d-44d2-a70c-e019bdfabdd8 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:24.416625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c2b3-3e7d-44d2-a70c-e019bdfabdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:24.417029 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c2b3-3e7d-44d2-a70c-e019bdfabdd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:24.435266 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8c2b3-3e7d-44d2-a70c-e019bdfabdd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:24.438778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed312c-cbe0-48bc-9804-06c5a1c797dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:24.439835 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed312c-cbe0-48bc-9804-06c5a1c797dc None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:24.440388 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed312c-cbe0-48bc-9804-06c5a1c797dc None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:24.440730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed312c-cbe0-48bc-9804-06c5a1c797dc None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:24.444830 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed312c-cbe0-48bc-9804-06c5a1c797dc None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:24.446438 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed312c-cbe0-48bc-9804-06c5a1c797dc None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-3ee8c2b3-3e7d-44d2-a70c-e019bdfabdd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:24.447730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:24.448611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:24.449400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:24.449400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:24.449400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:24.449400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:24.449400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:24.449400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:24.449400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:24.449400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:24.449400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:24.449400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:24.449400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:24.449400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:24.449992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 149/287] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:24 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:24.453566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 139/288] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:24.458580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed312c-cbe0-48bc-9804-06c5a1c797dc None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:24.459692 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c2b3-3e7d-44d2-a70c-e019bdfabdd8 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:24.487775 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:24.608932 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:24.683164 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed312c-cbe0-48bc-9804-06c5a1c797dc None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:24.728570 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c2b3-3e7d-44d2-a70c-e019bdfabdd8 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:24.737218 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd73c6-9616-47ca-b6ac-107b96444e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:24.738215 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd73c6-9616-47ca-b6ac-107b96444e16 None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:24.738533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd73c6-9616-47ca-b6ac-107b96444e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:24.738841 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd73c6-9616-47ca-b6ac-107b96444e16 None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc/users/1c07bf44e7ef45e0b564831bf35c263b/roles/ef38bd64ddca4058879ee2f751de5470` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:24.745837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd73c6-9616-47ca-b6ac-107b96444e16 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ad01a9f12cd4be89048efd0d4cd70cc, user_id=1c07bf44e7ef45e0b564831bf35c263b, role_id=ef38bd64ddca4058879ee2f751de5470)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:24.747638 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd73c6-9616-47ca-b6ac-107b96444e16 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:24.773521 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 150/289] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:40:24 2022] PUT /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc/users/1c07bf44e7ef45e0b564831bf35c263b/roles/ef38bd64ddca4058879ee2f751de5470 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:24.785646 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17de79-0647-42e8-b650-e5781215494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:24.786934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17de79-0647-42e8-b650-e5781215494e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:24.787315 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17de79-0647-42e8-b650-e5781215494e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:24.787680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17de79-0647-42e8-b650-e5781215494e None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:24.788967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17de79-0647-42e8-b650-e5781215494e None admin] RBAC: Adding query filter params (name=member) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:24.789322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17de79-0647-42e8-b650-e5781215494e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:24.791439 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17de79-0647-42e8-b650-e5781215494e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:24.804222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 140/290] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:24.813899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd73c6-9616-47ca-b6ac-107b96444e16 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:24.970906 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:25.025459 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd73c6-9616-47ca-b6ac-107b96444e16 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:25.079228 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406cc2b-c811-4f3f-a6ce-ebc8b3333396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:25.080593 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406cc2b-c811-4f3f-a6ce-ebc8b3333396 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:25.081247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406cc2b-c811-4f3f-a6ce-ebc8b3333396 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:25.081814 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406cc2b-c811-4f3f-a6ce-ebc8b3333396 None admin] PATH_INFO: `/v3/users/e59fa90456984e71884a0fad642a875b` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:25.083545 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406cc2b-c811-4f3f-a6ce-ebc8b3333396 None admin] RBAC: Authorizing `identity:get_user(user_id=e59fa90456984e71884a0fad642a875b)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:25.085671 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406cc2b-c811-4f3f-a6ce-ebc8b3333396 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:25.088207 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 151/291] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:24 2022] GET /identity/v3/users/e59fa90456984e71884a0fad642a875b => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:25.094656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17de79-0647-42e8-b650-e5781215494e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:25.289597 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17de79-0647-42e8-b650-e5781215494e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:25.330556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:25.353286 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c63fe4-b2c9-469b-86f8-f93725c5cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:25.353981 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c63fe4-b2c9-469b-86f8-f93725c5cb9b None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:25.354270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c63fe4-b2c9-469b-86f8-f93725c5cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:25.354550 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c63fe4-b2c9-469b-86f8-f93725c5cb9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:25.455862 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c63fe4-b2c9-469b-86f8-f93725c5cb9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:25.457420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c63fe4-b2c9-469b-86f8-f93725c5cb9b None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:25.588224 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 141/292] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:25.590764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406cc2b-c811-4f3f-a6ce-ebc8b3333396 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:25.797442 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406cc2b-c811-4f3f-a6ce-ebc8b3333396 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:25.844536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce2a2d-1438-4264-b7eb-69c17cd81efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:25.845797 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce2a2d-1438-4264-b7eb-69c17cd81efd None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:25.846390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce2a2d-1438-4264-b7eb-69c17cd81efd None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:25.846877 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce2a2d-1438-4264-b7eb-69c17cd81efd None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:25.848627 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce2a2d-1438-4264-b7eb-69c17cd81efd None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:25.850562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce2a2d-1438-4264-b7eb-69c17cd81efd None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:25.853391 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 152/293] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:25 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:25.859996 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c63fe4-b2c9-469b-86f8-f93725c5cb9b None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:25.891745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:25.987767 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c63fe4-b2c9-469b-86f8-f93725c5cb9b None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:26.025345 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaa020-7346-46df-83b1-a71af428db07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:26.026267 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaa020-7346-46df-83b1-a71af428db07 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:26.026725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaa020-7346-46df-83b1-a71af428db07 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:26.027145 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaa020-7346-46df-83b1-a71af428db07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:26.028168 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaa020-7346-46df-83b1-a71af428db07 None admin] RBAC: Adding query filter params (role.id=4a110f9a625548a990ed70fad43f73b0, scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc, user.id=e59fa90456984e71884a0fad642a875b) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:26.028631 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaa020-7346-46df-83b1-a71af428db07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:26.030499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaa020-7346-46df-83b1-a71af428db07 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:26.037489 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 142/294] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:25 2022] GET /identity/v3/role_assignments?user.id=e59fa90456984e71884a0fad642a875b&scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc&role.id=4a110f9a625548a990ed70fad43f73b0 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:26.603846 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0076d4c-eaa7-4ce7-9076-e9d61f47fa66 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:26.604894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0076d4c-eaa7-4ce7-9076-e9d61f47fa66 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:26.605358 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0076d4c-eaa7-4ce7-9076-e9d61f47fa66 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:26.607385 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 153/295] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:26.614895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728b2e1-fdca-41fb-b0e5-bceb9379539b None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:26.616391 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160803a-d870-4c6d-bd7c-8ddd9da6f3c6 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:26.616690 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160803a-d870-4c6d-bd7c-8ddd9da6f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:26.616973 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160803a-d870-4c6d-bd7c-8ddd9da6f3c6 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:26.618611 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 154/296] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:40:26.618792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728b2e1-fdca-41fb-b0e5-bceb9379539b None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:26.619095 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728b2e1-fdca-41fb-b0e5-bceb9379539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:26.625314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991e8d6-3c10-49d3-80b3-bcdd46c86401 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:26.625652 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991e8d6-3c10-49d3-80b3-bcdd46c86401 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:26.625997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991e8d6-3c10-49d3-80b3-bcdd46c86401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:26.644837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-4728b2e1-fdca-41fb-b0e5-bceb9379539b None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:26.646063 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-4728b2e1-fdca-41fb-b0e5-bceb9379539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:26.647693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:26.659067 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-7991e8d6-3c10-49d3-80b3-bcdd46c86401 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:26.660705 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-7991e8d6-3c10-49d3-80b3-bcdd46c86401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:26.751372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 155/297] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:26.760137 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 143/298] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:26.782372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991e8d6-3c10-49d3-80b3-bcdd46c86401 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:26.789544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728b2e1-fdca-41fb-b0e5-bceb9379539b None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:26.819908 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:26.923607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991e8d6-3c10-49d3-80b3-bcdd46c86401 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:26.925657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728b2e1-fdca-41fb-b0e5-bceb9379539b None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:26.965505 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96246199-be0a-42d4-9623-bf35969483ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:26.966322 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246199-be0a-42d4-9623-bf35969483ba None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:26.966853 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246199-be0a-42d4-9623-bf35969483ba None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:26.967660 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246199-be0a-42d4-9623-bf35969483ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:26.967971 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d43385-2769-44e9-9bc9-3d9ef4859c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:26.969096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96246199-be0a-42d4-9623-bf35969483ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:26.969332 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d43385-2769-44e9-9bc9-3d9ef4859c45 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:26.969717 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d43385-2769-44e9-9bc9-3d9ef4859c45 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:26.970110 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d43385-2769-44e9-9bc9-3d9ef4859c45 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:26.970747 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96246199-be0a-42d4-9623-bf35969483ba None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:26.973157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 156/299] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:26.979986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96246199-be0a-42d4-9623-bf35969483ba None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:26.985852 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:26.988445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d43385-2769-44e9-9bc9-3d9ef4859c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-87d43385-2769-44e9-9bc9-3d9ef4859c45 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:27.000421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:27.001652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:27.002802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:27.002802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:27.002802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:27.002802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:27.002802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:27.002802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:27.002802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:27.002802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:27.002802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:27.002802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:27.002802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:27.002802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:27.006362 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 144/300] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:27.013772 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d43385-2769-44e9-9bc9-3d9ef4859c45 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:27.120778 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:27.130353 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96246199-be0a-42d4-9623-bf35969483ba None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:27.149367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d43385-2769-44e9-9bc9-3d9ef4859c45 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:27.179438 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fdb24-2507-4640-96d7-98255f8d5ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:27.180577 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fdb24-2507-4640-96d7-98255f8d5ca6 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.181089 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fdb24-2507-4640-96d7-98255f8d5ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.181591 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fdb24-2507-4640-96d7-98255f8d5ca6 None admin] PATH_INFO: `/v3/groups` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.183162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fdb24-2507-4640-96d7-98255f8d5ca6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:27.185264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fdb24-2507-4640-96d7-98255f8d5ca6 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:27.200008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010dd6b-8960-473d-9ec9-c396ed328097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:27.201244 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010dd6b-8960-473d-9ec9-c396ed328097 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.202872 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010dd6b-8960-473d-9ec9-c396ed328097 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.203598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010dd6b-8960-473d-9ec9-c396ed328097 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.204854 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010dd6b-8960-473d-9ec9-c396ed328097 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:27.205400 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 157/301] 10.222.0.24 () {60 vars in 1134 bytes} [Wed May 25 13:40:26 2022] POST /identity/v3/groups => generated 229 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:40:27.205660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010dd6b-8960-473d-9ec9-c396ed328097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:27.207521 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010dd6b-8960-473d-9ec9-c396ed328097 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:27.222237 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 145/302] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:27.232029 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fdb24-2507-4640-96d7-98255f8d5ca6 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:27.261297 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12844e8-cdeb-44fb-b3d3-275a26bd72c9 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.262240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12844e8-cdeb-44fb-b3d3-275a26bd72c9 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.262950 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12844e8-cdeb-44fb-b3d3-275a26bd72c9 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.266748 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 146/303] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:27.275110 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbea1e5-126d-42dd-837c-ef90d4f49b28 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.275874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbea1e5-126d-42dd-837c-ef90d4f49b28 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.276268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbea1e5-126d-42dd-837c-ef90d4f49b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.302885 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-bbbea1e5-126d-42dd-837c-ef90d4f49b28 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:27.304939 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-bbbea1e5-126d-42dd-837c-ef90d4f49b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:27.320252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:27.386880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fdb24-2507-4640-96d7-98255f8d5ca6 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:27.420263 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 147/304] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:27.439357 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3852bc-e38f-4db2-a64e-287a0c6ff693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:27.440247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3852bc-e38f-4db2-a64e-287a0c6ff693 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.440534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3852bc-e38f-4db2-a64e-287a0c6ff693 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.440810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3852bc-e38f-4db2-a64e-287a0c6ff693 None admin] PATH_INFO: `/v3/users/b642fb3dc2a14f9d90b0049618d8aa34` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.443157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbea1e5-126d-42dd-837c-ef90d4f49b28 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:27.460388 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3852bc-e38f-4db2-a64e-287a0c6ff693 None admin] RBAC: Authorizing `identity:get_user(user_id=b642fb3dc2a14f9d90b0049618d8aa34)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:27.462344 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3852bc-e38f-4db2-a64e-287a0c6ff693 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:27.464265 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 158/305] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:27 2022] GET /identity/v3/users/b642fb3dc2a14f9d90b0049618d8aa34 => generated 293 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:27.470840 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3852bc-e38f-4db2-a64e-287a0c6ff693 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:27.533406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:27.584220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbea1e5-126d-42dd-837c-ef90d4f49b28 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:27.614658 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3852bc-e38f-4db2-a64e-287a0c6ff693 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:27.632613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70459128-4c45-4108-bdea-6cd29907cb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:27.635074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459128-4c45-4108-bdea-6cd29907cb5d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.635595 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459128-4c45-4108-bdea-6cd29907cb5d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.636299 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459128-4c45-4108-bdea-6cd29907cb5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.652880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:27.661419 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70459128-4c45-4108-bdea-6cd29907cb5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:27.671787 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbbd68-65dc-42eb-b99d-41a59ec60aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-70459128-4c45-4108-bdea-6cd29907cb5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:27.672513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:27.673632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:27.674433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:27.674433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:27.674433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:27.674433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:27.674433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:27.674433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:27.674433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:27.674433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:27.674433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:27.674433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:27.674433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:27.674433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:27.675157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 148/306] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:27.676408 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbbd68-65dc-42eb-b99d-41a59ec60aa2 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.676926 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbbd68-65dc-42eb-b99d-41a59ec60aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.677536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbbd68-65dc-42eb-b99d-41a59ec60aa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.678728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbbd68-65dc-42eb-b99d-41a59ec60aa2 None admin] RBAC: Adding query filter params (role.id=ef38bd64ddca4058879ee2f751de5470, user.id=b642fb3dc2a14f9d90b0049618d8aa34, scope.system=all) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:27.679275 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbbd68-65dc-42eb-b99d-41a59ec60aa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:27.681132 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbbd68-65dc-42eb-b99d-41a59ec60aa2 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:27.681958 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70459128-4c45-4108-bdea-6cd29907cb5d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:27.691709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 159/307] 10.222.0.24 () {56 vars in 1308 bytes} [Wed May 25 13:40:27 2022] GET /identity/v3/role_assignments?user.id=b642fb3dc2a14f9d90b0049618d8aa34&scope.system=all&role.id=ef38bd64ddca4058879ee2f751de5470 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:27.793997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae1a77-c126-493d-9672-4cb7d409404e None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.794379 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae1a77-c126-493d-9672-4cb7d409404e None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.794684 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae1a77-c126-493d-9672-4cb7d409404e None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.796854 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 160/308] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:27.803568 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d607a3-443f-4a8e-80aa-f2df345e16cd None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.804069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d607a3-443f-4a8e-80aa-f2df345e16cd None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.804387 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d607a3-443f-4a8e-80aa-f2df345e16cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.828850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-10d607a3-443f-4a8e-80aa-f2df345e16cd None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:27.831707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-10d607a3-443f-4a8e-80aa-f2df345e16cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:27.833416 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70459128-4c45-4108-bdea-6cd29907cb5d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:27.881639 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:27.894309 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae8466-4499-4d44-819d-de1948505992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:27.896529 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae8466-4499-4d44-819d-de1948505992 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.897092 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae8466-4499-4d44-819d-de1948505992 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.897577 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae8466-4499-4d44-819d-de1948505992 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.898553 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae8466-4499-4d44-819d-de1948505992 None admin] RBAC: Adding query filter params (name=member) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:27.899059 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae8466-4499-4d44-819d-de1948505992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:27.900766 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae8466-4499-4d44-819d-de1948505992 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:27.915514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 149/309] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:27.921563 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae8466-4499-4d44-819d-de1948505992 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:27.954200 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 161/310] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:27.994783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d607a3-443f-4a8e-80aa-f2df345e16cd None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:28.071048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae8466-4499-4d44-819d-de1948505992 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:28.121575 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd30c14-a368-49af-9bdb-4d40e16569bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:28.122778 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd30c14-a368-49af-9bdb-4d40e16569bb None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:28.123451 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd30c14-a368-49af-9bdb-4d40e16569bb None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:28.124015 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd30c14-a368-49af-9bdb-4d40e16569bb None admin] PATH_INFO: `/v3/users/9022115caac348f18733a97291721970` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:28.125574 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd30c14-a368-49af-9bdb-4d40e16569bb None admin] RBAC: Authorizing `identity:get_user(user_id=9022115caac348f18733a97291721970)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:28.127996 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd30c14-a368-49af-9bdb-4d40e16569bb None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:28.130592 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 150/311] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:27 2022] GET /identity/v3/users/9022115caac348f18733a97291721970 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:28.137029 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd30c14-a368-49af-9bdb-4d40e16569bb None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:28.165119 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d607a3-443f-4a8e-80aa-f2df345e16cd None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:28.187706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:28.210154 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5717400-5513-4999-b512-fa719ed3cc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:28.211195 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5717400-5513-4999-b512-fa719ed3cc49 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:28.211195 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5717400-5513-4999-b512-fa719ed3cc49 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:28.211526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5717400-5513-4999-b512-fa719ed3cc49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:28.225879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5717400-5513-4999-b512-fa719ed3cc49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:28.232247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-b5717400-5513-4999-b512-fa719ed3cc49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:28.236502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:28.237666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:28.238590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:28.238590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:28.238590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:28.238590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:28.238590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:28.238590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:28.238590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:28.238590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:28.238590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:28.238590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:28.238590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:28.238590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:28.242839 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 162/312] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:28.243887 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5717400-5513-4999-b512-fa719ed3cc49 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:28.291879 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd30c14-a368-49af-9bdb-4d40e16569bb None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:28.336017 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add70690-5eea-4928-88a8-ca3ad4395761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:28.336961 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add70690-5eea-4928-88a8-ca3ad4395761 None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:28.337250 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add70690-5eea-4928-88a8-ca3ad4395761 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:28.337529 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add70690-5eea-4928-88a8-ca3ad4395761 None admin] PATH_INFO: `/v3/system/users/9022115caac348f18733a97291721970/roles/4a110f9a625548a990ed70fad43f73b0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:28.339349 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add70690-5eea-4928-88a8-ca3ad4395761 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9022115caac348f18733a97291721970, role_id=4a110f9a625548a990ed70fad43f73b0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:28.340756 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add70690-5eea-4928-88a8-ca3ad4395761 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:28.364166 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 151/313] 10.222.0.24 () {58 vars in 1334 bytes} [Wed May 25 13:40:28 2022] PUT /identity/v3/system/users/9022115caac348f18733a97291721970/roles/4a110f9a625548a990ed70fad43f73b0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:28.413131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5717400-5513-4999-b512-fa719ed3cc49 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:28.458441 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02d900-f45b-4566-8cbe-cfb4be4daf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:28.459132 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02d900-f45b-4566-8cbe-cfb4be4daf37 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:28.459479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02d900-f45b-4566-8cbe-cfb4be4daf37 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:28.459749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02d900-f45b-4566-8cbe-cfb4be4daf37 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:28.460697 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02d900-f45b-4566-8cbe-cfb4be4daf37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:28.460935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02d900-f45b-4566-8cbe-cfb4be4daf37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:28.462820 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02d900-f45b-4566-8cbe-cfb4be4daf37 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:28.474896 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 163/314] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:28.480836 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add70690-5eea-4928-88a8-ca3ad4395761 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:28.617053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add70690-5eea-4928-88a8-ca3ad4395761 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:28.645522 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:28.660070 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe30d2-6557-4669-bfaf-66c9eeb8e8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:28.660988 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe30d2-6557-4669-bfaf-66c9eeb8e8d3 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:28.661273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe30d2-6557-4669-bfaf-66c9eeb8e8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:28.661557 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe30d2-6557-4669-bfaf-66c9eeb8e8d3 None admin] PATH_INFO: `/v3/users/1c07bf44e7ef45e0b564831bf35c263b` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:28.662807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe30d2-6557-4669-bfaf-66c9eeb8e8d3 None admin] RBAC: Authorizing `identity:get_user(user_id=1c07bf44e7ef45e0b564831bf35c263b)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:28.664310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe30d2-6557-4669-bfaf-66c9eeb8e8d3 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:28.666361 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 152/315] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:28 2022] GET /identity/v3/users/1c07bf44e7ef45e0b564831bf35c263b => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:28.672464 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02d900-f45b-4566-8cbe-cfb4be4daf37 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:28.725806 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:28.794911 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02d900-f45b-4566-8cbe-cfb4be4daf37 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:28.831707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bea25-eae6-41e0-8f57-1a135275e4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:28.832477 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bea25-eae6-41e0-8f57-1a135275e4d9 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:28.832766 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bea25-eae6-41e0-8f57-1a135275e4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:28.833047 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bea25-eae6-41e0-8f57-1a135275e4d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:28.910606 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bea25-eae6-41e0-8f57-1a135275e4d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:28.912095 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bea25-eae6-41e0-8f57-1a135275e4d9 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:28.956853 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:29.028214 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 164/316] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:29.033653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe30d2-6557-4669-bfaf-66c9eeb8e8d3 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:29.151885 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe30d2-6557-4669-bfaf-66c9eeb8e8d3 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:29.196188 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08e54c-22e2-4f75-8e96-f23193f59cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:29.197077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08e54c-22e2-4f75-8e96-f23193f59cc2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:29.197360 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08e54c-22e2-4f75-8e96-f23193f59cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:29.197640 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08e54c-22e2-4f75-8e96-f23193f59cc2 None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:29.198912 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08e54c-22e2-4f75-8e96-f23193f59cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:29.200409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08e54c-22e2-4f75-8e96-f23193f59cc2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:29.203462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 153/317] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:29 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:29.209232 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bea25-eae6-41e0-8f57-1a135275e4d9 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:29.316562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bea25-eae6-41e0-8f57-1a135275e4d9 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:29.358513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736bb8d-6fd9-4bad-8c3d-373eefb8420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:29.359203 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736bb8d-6fd9-4bad-8c3d-373eefb8420a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:29.359790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736bb8d-6fd9-4bad-8c3d-373eefb8420a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:29.360068 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736bb8d-6fd9-4bad-8c3d-373eefb8420a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:29.361113 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736bb8d-6fd9-4bad-8c3d-373eefb8420a None admin] RBAC: Adding query filter params (role.id=ef38bd64ddca4058879ee2f751de5470, scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc, user.id=1c07bf44e7ef45e0b564831bf35c263b) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:29.361429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736bb8d-6fd9-4bad-8c3d-373eefb8420a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:29.362980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736bb8d-6fd9-4bad-8c3d-373eefb8420a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:29.370702 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 165/318] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:29 2022] GET /identity/v3/role_assignments?user.id=1c07bf44e7ef45e0b564831bf35c263b&scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc&role.id=ef38bd64ddca4058879ee2f751de5470 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:29.741252 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e392fb-d8cd-427e-a432-2c5afdbe9b62 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:29.741787 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e392fb-d8cd-427e-a432-2c5afdbe9b62 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:29.741787 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e392fb-d8cd-427e-a432-2c5afdbe9b62 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:29.743203 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 154/319] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:29.749176 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc537029-cc46-48c9-a5a8-04da27a77ebe None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:29.749784 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc537029-cc46-48c9-a5a8-04da27a77ebe None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:29.750064 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc537029-cc46-48c9-a5a8-04da27a77ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:29.755157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:29.768212 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-bc537029-cc46-48c9-a5a8-04da27a77ebe None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:29.769770 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-bc537029-cc46-48c9-a5a8-04da27a77ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:29.842175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 166/320] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:29.865967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e392fb-d8cd-427e-a432-2c5afdbe9b62 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:29.934215 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:29.982194 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e392fb-d8cd-427e-a432-2c5afdbe9b62 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:30.017636 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e148a-52dc-4652-846a-be8d0b8baf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:30.018322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e148a-52dc-4652-846a-be8d0b8baf2b None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:30.018601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e148a-52dc-4652-846a-be8d0b8baf2b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:30.018871 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e148a-52dc-4652-846a-be8d0b8baf2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:30.020039 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e148a-52dc-4652-846a-be8d0b8baf2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:30.021520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e148a-52dc-4652-846a-be8d0b8baf2b None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:30.023303 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 155/321] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:30.028739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc537029-cc46-48c9-a5a8-04da27a77ebe None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:30.069076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119913f9-bec6-4452-9a3b-5f90b0b16a93 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:30.069415 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119913f9-bec6-4452-9a3b-5f90b0b16a93 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:30.069639 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119913f9-bec6-4452-9a3b-5f90b0b16a93 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:30.071222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 156/322] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:30.077153 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16db06-e2db-4217-b178-b88c8bd06369 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:30.077635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16db06-e2db-4217-b178-b88c8bd06369 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:30.078032 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16db06-e2db-4217-b178-b88c8bd06369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:30.096300 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-2b16db06-e2db-4217-b178-b88c8bd06369 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:30.097568 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-2b16db06-e2db-4217-b178-b88c8bd06369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:30.152002 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc537029-cc46-48c9-a5a8-04da27a77ebe None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:30.177261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 157/323] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:30.184130 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:30.191031 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97796de2-1fd0-4eec-bf48-80ae1057c855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:30.191713 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97796de2-1fd0-4eec-bf48-80ae1057c855 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:30.191992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97796de2-1fd0-4eec-bf48-80ae1057c855 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:30.192295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97796de2-1fd0-4eec-bf48-80ae1057c855 None admin] PATH_INFO: `/v3/groups` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:30.193001 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97796de2-1fd0-4eec-bf48-80ae1057c855 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:30.194455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97796de2-1fd0-4eec-bf48-80ae1057c855 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:30.200548 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16db06-e2db-4217-b178-b88c8bd06369 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:30.210298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 167/324] 10.222.0.24 () {60 vars in 1134 bytes} [Wed May 25 13:40:30 2022] POST /identity/v3/groups => generated 226 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:40:30.271213 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:30.325080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16db06-e2db-4217-b178-b88c8bd06369 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:30.367325 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2d6cc-56ea-456a-8521-91dc2e4fee27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:30.368189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d6cc-56ea-456a-8521-91dc2e4fee27 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:30.368580 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d6cc-56ea-456a-8521-91dc2e4fee27 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:30.368742 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d6cc-56ea-456a-8521-91dc2e4fee27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:30.386102 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2d6cc-56ea-456a-8521-91dc2e4fee27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-1dc2d6cc-56ea-456a-8521-91dc2e4fee27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:30.396041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:30.397115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:30.397902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 158/325] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:30.406112 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97796de2-1fd0-4eec-bf48-80ae1057c855 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:30.540705 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97796de2-1fd0-4eec-bf48-80ae1057c855 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:30.581666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406a6a6-43cd-4892-95ce-8d60bf3e87b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:30.582372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a6a6-43cd-4892-95ce-8d60bf3e87b5 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:30.582653 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a6a6-43cd-4892-95ce-8d60bf3e87b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:30.582923 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a6a6-43cd-4892-95ce-8d60bf3e87b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:30.583686 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406a6a6-43cd-4892-95ce-8d60bf3e87b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:30.584000 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406a6a6-43cd-4892-95ce-8d60bf3e87b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:30.585427 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406a6a6-43cd-4892-95ce-8d60bf3e87b5 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:30.594623 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 168/326] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:30.600393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2d6cc-56ea-456a-8521-91dc2e4fee27 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:30.735850 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2d6cc-56ea-456a-8521-91dc2e4fee27 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:30.758974 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:30.781249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aee2e3-401c-4528-9e35-0165a824511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:30.782177 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee2e3-401c-4528-9e35-0165a824511c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:30.782416 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee2e3-401c-4528-9e35-0165a824511c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:30.782690 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee2e3-401c-4528-9e35-0165a824511c None admin] PATH_INFO: `/v3/users/b642fb3dc2a14f9d90b0049618d8aa34` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:30.784285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aee2e3-401c-4528-9e35-0165a824511c None admin] RBAC: Authorizing `identity:get_user(user_id=b642fb3dc2a14f9d90b0049618d8aa34)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:30.785754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aee2e3-401c-4528-9e35-0165a824511c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:30.787676 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 159/327] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:30 2022] GET /identity/v3/users/b642fb3dc2a14f9d90b0049618d8aa34 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:30.793403 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406a6a6-43cd-4892-95ce-8d60bf3e87b5 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:30.825284 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47228453-cb28-4c27-80cb-bbc9d4593a6e None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:30.825950 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47228453-cb28-4c27-80cb-bbc9d4593a6e None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:30.827209 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47228453-cb28-4c27-80cb-bbc9d4593a6e None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:30.829338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 160/328] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:40:30.837037 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a432fb-0e05-4c47-ad95-4963805ce402 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:30.837641 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a432fb-0e05-4c47-ad95-4963805ce402 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:30.838138 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a432fb-0e05-4c47-ad95-4963805ce402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:30.867004 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-c9a432fb-0e05-4c47-ad95-4963805ce402 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:30.868966 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-c9a432fb-0e05-4c47-ad95-4963805ce402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:30.877675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:30.933501 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406a6a6-43cd-4892-95ce-8d60bf3e87b5 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:30.974157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faec56-fdb0-4480-aa6a-fc5a723a9e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:30.974716 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 161/329] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:30.975405 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faec56-fdb0-4480-aa6a-fc5a723a9e3c None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:30.975696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faec56-fdb0-4480-aa6a-fc5a723a9e3c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:30.976131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faec56-fdb0-4480-aa6a-fc5a723a9e3c None admin] PATH_INFO: `/v3/system/users/b642fb3dc2a14f9d90b0049618d8aa34/roles/ef38bd64ddca4058879ee2f751de5470` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:30.979704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8faec56-fdb0-4480-aa6a-fc5a723a9e3c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b642fb3dc2a14f9d90b0049618d8aa34, role_id=ef38bd64ddca4058879ee2f751de5470)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:30.981395 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8faec56-fdb0-4480-aa6a-fc5a723a9e3c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:30.993533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 169/330] 10.222.0.24 () {58 vars in 1334 bytes} [Wed May 25 13:40:30 2022] PUT /identity/v3/system/users/b642fb3dc2a14f9d90b0049618d8aa34/roles/ef38bd64ddca4058879ee2f751de5470 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:31.006354 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a432fb-0e05-4c47-ad95-4963805ce402 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:31.159110 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a432fb-0e05-4c47-ad95-4963805ce402 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:31.178815 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:31.205995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473e64c-3090-4326-bb3b-4f02caed468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:31.206854 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473e64c-3090-4326-bb3b-4f02caed468f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:31.207135 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473e64c-3090-4326-bb3b-4f02caed468f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:31.207408 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473e64c-3090-4326-bb3b-4f02caed468f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:31.222132 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473e64c-3090-4326-bb3b-4f02caed468f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-9473e64c-3090-4326-bb3b-4f02caed468f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:31.233929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:31.234886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:31.235665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:31.235665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:31.235665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:31.235665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:31.235665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:31.235665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:31.235665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:31.235665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:31.235665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:31.235665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:31.235665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:31.235665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:31.236281 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 162/331] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:31.244734 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faec56-fdb0-4480-aa6a-fc5a723a9e3c None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:31.390322 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faec56-fdb0-4480-aa6a-fc5a723a9e3c None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:31.413733 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:31.438450 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b954cc3-7966-4ae2-91e4-c7015409f2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:31.439257 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954cc3-7966-4ae2-91e4-c7015409f2d0 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:31.439571 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954cc3-7966-4ae2-91e4-c7015409f2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:31.439912 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954cc3-7966-4ae2-91e4-c7015409f2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:31.440924 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b954cc3-7966-4ae2-91e4-c7015409f2d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:31.441262 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b954cc3-7966-4ae2-91e4-c7015409f2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:31.442950 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b954cc3-7966-4ae2-91e4-c7015409f2d0 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:31.457650 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 170/332] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:31.464248 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473e64c-3090-4326-bb3b-4f02caed468f None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:31.609008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473e64c-3090-4326-bb3b-4f02caed468f None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:31.662146 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895fbfe-bf4b-42a3-b772-4edfb6b0bd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:31.663331 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895fbfe-bf4b-42a3-b772-4edfb6b0bd1e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:31.663802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895fbfe-bf4b-42a3-b772-4edfb6b0bd1e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:31.664029 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895fbfe-bf4b-42a3-b772-4edfb6b0bd1e None admin] PATH_INFO: `/v3/users/9022115caac348f18733a97291721970` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:31.665846 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895fbfe-bf4b-42a3-b772-4edfb6b0bd1e None admin] RBAC: Authorizing `identity:get_user(user_id=9022115caac348f18733a97291721970)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:31.668037 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895fbfe-bf4b-42a3-b772-4edfb6b0bd1e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:31.673132 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 163/333] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:31 2022] GET /identity/v3/users/9022115caac348f18733a97291721970 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:31.679613 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b954cc3-7966-4ae2-91e4-c7015409f2d0 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:31.874888 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b954cc3-7966-4ae2-91e4-c7015409f2d0 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:31.918812 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce9cc3-e53b-4d74-abdc-ce3ef327d8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:31.919846 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce9cc3-e53b-4d74-abdc-ce3ef327d8ff None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:31.920520 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce9cc3-e53b-4d74-abdc-ce3ef327d8ff None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:31.921208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce9cc3-e53b-4d74-abdc-ce3ef327d8ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:31.922287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce9cc3-e53b-4d74-abdc-ce3ef327d8ff None admin] RBAC: Adding query filter params (role.id=4a110f9a625548a990ed70fad43f73b0, user.id=9022115caac348f18733a97291721970, scope.system=all) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:31.922813 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce9cc3-e53b-4d74-abdc-ce3ef327d8ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:31.924569 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce9cc3-e53b-4d74-abdc-ce3ef327d8ff None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:31.945379 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 171/334] 10.222.0.24 () {56 vars in 1308 bytes} [Wed May 25 13:40:31 2022] GET /identity/v3/role_assignments?user.id=9022115caac348f18733a97291721970&scope.system=all&role.id=4a110f9a625548a990ed70fad43f73b0 => generated 510 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:33.553304 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414de359-bfe1-4be5-bac0-d9a3455ec0e7 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:33.553867 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414de359-bfe1-4be5-bac0-d9a3455ec0e7 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:33.553867 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414de359-bfe1-4be5-bac0-d9a3455ec0e7 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:33.555672 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 164/335] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:33.562190 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748f74a-dd66-4696-995f-64df8c304644 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:33.562761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748f74a-dd66-4696-995f-64df8c304644 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:33.562761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748f74a-dd66-4696-995f-64df8c304644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:33.586895 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-8748f74a-dd66-4696-995f-64df8c304644 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:33.588215 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-8748f74a-dd66-4696-995f-64df8c304644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:33.628760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:33.677392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 172/336] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:33.731168 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414de359-bfe1-4be5-bac0-d9a3455ec0e7 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:33.801916 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:33.882074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414de359-bfe1-4be5-bac0-d9a3455ec0e7 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:33.932940 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c570d4-ad8b-4788-a928-38693a2b992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:33.934182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c570d4-ad8b-4788-a928-38693a2b992d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:33.934680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c570d4-ad8b-4788-a928-38693a2b992d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:33.935164 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c570d4-ad8b-4788-a928-38693a2b992d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:33.952559 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c570d4-ad8b-4788-a928-38693a2b992d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-39c570d4-ad8b-4788-a928-38693a2b992d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:33.960995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:33.961946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:33.962732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:33.962732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:33.962732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:33.962732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:33.962732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:33.962732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:33.962732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:33.962732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:33.962732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:33.962732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:33.962732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:33.962732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:33.967004 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 165/337] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:33.975433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748f74a-dd66-4696-995f-64df8c304644 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:34.120822 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748f74a-dd66-4696-995f-64df8c304644 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:34.163702 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c431b89-ef20-4dcd-9f72-e51807a3a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:34.164335 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c431b89-ef20-4dcd-9f72-e51807a3a261 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:34.164623 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c431b89-ef20-4dcd-9f72-e51807a3a261 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:34.164909 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c431b89-ef20-4dcd-9f72-e51807a3a261 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:34.165669 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c431b89-ef20-4dcd-9f72-e51807a3a261 None admin] RBAC: Adding query filter params (name=member) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:34.165986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c431b89-ef20-4dcd-9f72-e51807a3a261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:34.167387 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c431b89-ef20-4dcd-9f72-e51807a3a261 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:34.179293 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 173/338] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:34.185920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c570d4-ad8b-4788-a928-38693a2b992d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:34.237711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7c98b-6894-47ec-a997-2ab97b961035 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:34.238033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7c98b-6894-47ec-a997-2ab97b961035 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:34.238281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7c98b-6894-47ec-a997-2ab97b961035 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:34.239656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 174/339] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:34.245828 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55173a1d-38f2-4fe3-8c6d-a3e38ec55265 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:34.246130 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55173a1d-38f2-4fe3-8c6d-a3e38ec55265 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:34.246391 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55173a1d-38f2-4fe3-8c6d-a3e38ec55265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:34.285349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-55173a1d-38f2-4fe3-8c6d-a3e38ec55265 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:34.286621 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-55173a1d-38f2-4fe3-8c6d-a3e38ec55265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:34.321442 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c570d4-ad8b-4788-a928-38693a2b992d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:34.323809 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:34.341859 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:34.373980 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60a2b2-1e48-4291-a50d-a447cfa87d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:34.375023 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a2b2-1e48-4291-a50d-a447cfa87d7a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:34.375498 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a2b2-1e48-4291-a50d-a447cfa87d7a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:34.375959 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a2b2-1e48-4291-a50d-a447cfa87d7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:34.452215 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 175/340] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 25 13:40:34.483182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60a2b2-1e48-4291-a50d-a447cfa87d7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:34.485084 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60a2b2-1e48-4291-a50d-a447cfa87d7a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:34.495261 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55173a1d-38f2-4fe3-8c6d-a3e38ec55265 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:34.662573 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 166/341] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:34.663690 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36727838-a679-47a3-8488-73e3fce0de08 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:34.663958 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36727838-a679-47a3-8488-73e3fce0de08 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:34.664285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36727838-a679-47a3-8488-73e3fce0de08 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:34.667105 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 167/342] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:34.667795 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36727838-a679-47a3-8488-73e3fce0de08 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:34.681374 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:34.743944 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55173a1d-38f2-4fe3-8c6d-a3e38ec55265 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:34.820833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b297b-ec5c-4019-88cc-0f94cf6143aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:34.823017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b297b-ec5c-4019-88cc-0f94cf6143aa None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:34.824502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b297b-ec5c-4019-88cc-0f94cf6143aa None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:34.824990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b297b-ec5c-4019-88cc-0f94cf6143aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:34.847253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b297b-ec5c-4019-88cc-0f94cf6143aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-928b297b-ec5c-4019-88cc-0f94cf6143aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:34.860975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:34.861982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:34.862764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:34.862764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:34.862764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:34.862764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:34.862764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:34.862764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:34.862764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:34.862764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:34.862764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:34.862764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:34.862764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:34.862764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:34.865707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 176/343] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:40:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:34.867513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2f47-e104-43de-a287-49d6e988d8eb None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:34.868025 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2f47-e104-43de-a287-49d6e988d8eb None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:34.868530 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2f47-e104-43de-a287-49d6e988d8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:34.880617 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36727838-a679-47a3-8488-73e3fce0de08 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:34.898006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-0dbc2f47-e104-43de-a287-49d6e988d8eb None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:34.899632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-0dbc2f47-e104-43de-a287-49d6e988d8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:34.924094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96d992-2be9-4854-bf9f-e40bae6a44ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:34.925011 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d992-2be9-4854-bf9f-e40bae6a44ec None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:34.925297 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d992-2be9-4854-bf9f-e40bae6a44ec None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:34.925578 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d992-2be9-4854-bf9f-e40bae6a44ec None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:34.926580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:34.931158 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96d992-2be9-4854-bf9f-e40bae6a44ec None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:34.933738 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96d992-2be9-4854-bf9f-e40bae6a44ec None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:34.940134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 168/344] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:34 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:34.940134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96d992-2be9-4854-bf9f-e40bae6a44ec None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:35.033951 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 177/345] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:35.035134 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc2f47-e104-43de-a287-49d6e988d8eb None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:35.124513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:35.163727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96d992-2be9-4854-bf9f-e40bae6a44ec None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:35.207704 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deefe00-3243-4d99-9b8e-84566bcd4f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:35.208418 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deefe00-3243-4d99-9b8e-84566bcd4f2c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:35.209454 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deefe00-3243-4d99-9b8e-84566bcd4f2c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:35.209742 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deefe00-3243-4d99-9b8e-84566bcd4f2c None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:35.210517 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deefe00-3243-4d99-9b8e-84566bcd4f2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:35.210830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deefe00-3243-4d99-9b8e-84566bcd4f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:35.216236 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deefe00-3243-4d99-9b8e-84566bcd4f2c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:35.226744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 169/346] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:35.227999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deefe00-3243-4d99-9b8e-84566bcd4f2c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:35.248706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc2f47-e104-43de-a287-49d6e988d8eb None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:35.306907 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54816f71-081b-46dd-983a-ccf4774e7003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:35.308374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54816f71-081b-46dd-983a-ccf4774e7003 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:35.308875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54816f71-081b-46dd-983a-ccf4774e7003 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:35.309379 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54816f71-081b-46dd-983a-ccf4774e7003 None admin] PATH_INFO: `/v3/groups/72719c57e37a4eba89ab83e908f4f61c` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:35.321395 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54816f71-081b-46dd-983a-ccf4774e7003 None admin] RBAC: Authorizing `identity:get_group(group_id=72719c57e37a4eba89ab83e908f4f61c)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:35.323654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54816f71-081b-46dd-983a-ccf4774e7003 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:35.331542 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 178/347] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:35 2022] GET /identity/v3/groups/72719c57e37a4eba89ab83e908f4f61c => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:35.333202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec9dc-c80e-492e-a53d-ee07821125c9 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:35.333551 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec9dc-c80e-492e-a53d-ee07821125c9 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:35.333957 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec9dc-c80e-492e-a53d-ee07821125c9 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:35.339798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 179/348] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:35.339798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea926c-3f4b-4090-89b9-a4bd75f8599c None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:35.339798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea926c-3f4b-4090-89b9-a4bd75f8599c None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:35.339798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea926c-3f4b-4090-89b9-a4bd75f8599c None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:35.339798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 180/349] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:35.341050 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea926c-3f4b-4090-89b9-a4bd75f8599c None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:35.367747 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:35.378999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deefe00-3243-4d99-9b8e-84566bcd4f2c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:35.426663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:35.432733 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a79f62-48ee-4ed5-9d66-5a8aa1a3e8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:35.433711 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a79f62-48ee-4ed5-9d66-5a8aa1a3e8f6 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:35.434159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a79f62-48ee-4ed5-9d66-5a8aa1a3e8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:35.434531 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a79f62-48ee-4ed5-9d66-5a8aa1a3e8f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:35.456828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a79f62-48ee-4ed5-9d66-5a8aa1a3e8f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-88a79f62-48ee-4ed5-9d66-5a8aa1a3e8f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:35.464964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:35.465907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 170/350] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:35.467081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a79f62-48ee-4ed5-9d66-5a8aa1a3e8f6 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:35.519902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea926c-3f4b-4090-89b9-a4bd75f8599c None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:35.581652 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece90a70-9232-41a7-b2fa-b3d7a2eea627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:35.582240 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece90a70-9232-41a7-b2fa-b3d7a2eea627 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:35.582521 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece90a70-9232-41a7-b2fa-b3d7a2eea627 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:35.582790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece90a70-9232-41a7-b2fa-b3d7a2eea627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:35.633103 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a79f62-48ee-4ed5-9d66-5a8aa1a3e8f6 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:35.678628 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991d886-8617-4346-800a-b7ca9de7d308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:35.679272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d886-8617-4346-800a-b7ca9de7d308 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:35.680211 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d886-8617-4346-800a-b7ca9de7d308 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:35.680211 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d886-8617-4346-800a-b7ca9de7d308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:35.682074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991d886-8617-4346-800a-b7ca9de7d308 None admin] RBAC: Adding query filter params (group.id=72719c57e37a4eba89ab83e908f4f61c, role.id=4a110f9a625548a990ed70fad43f73b0, scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:35.682406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991d886-8617-4346-800a-b7ca9de7d308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:35.683354 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece90a70-9232-41a7-b2fa-b3d7a2eea627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:35.683908 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991d886-8617-4346-800a-b7ca9de7d308 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:35.685275 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece90a70-9232-41a7-b2fa-b3d7a2eea627 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:35.690981 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 171/351] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 13:40:35 2022] GET /identity/v3/role_assignments?group.id=72719c57e37a4eba89ab83e908f4f61c&scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0&role.id=4a110f9a625548a990ed70fad43f73b0 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:35.692364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a263a1b-e737-449c-abb0-f7d0f7e26602 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:35.692712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a263a1b-e737-449c-abb0-f7d0f7e26602 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:35.693010 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a263a1b-e737-449c-abb0-f7d0f7e26602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:35.714023 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:35.727578 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-0a263a1b-e737-449c-abb0-f7d0f7e26602 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:35.728891 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-0a263a1b-e737-449c-abb0-f7d0f7e26602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:35.804744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:35.837049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 172/352] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:35.838389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a950efa-d836-4e0e-b5a5-a14dc78e3c12 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:35.838681 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a950efa-d836-4e0e-b5a5-a14dc78e3c12 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:35.838959 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a950efa-d836-4e0e-b5a5-a14dc78e3c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:35.844680 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 181/353] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:35.849174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece90a70-9232-41a7-b2fa-b3d7a2eea627 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:35.872299 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-3a950efa-d836-4e0e-b5a5-a14dc78e3c12 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:35.875306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-3a950efa-d836-4e0e-b5a5-a14dc78e3c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:35.975654 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 173/354] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:35.976608 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a950efa-d836-4e0e-b5a5-a14dc78e3c12 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:35.999852 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece90a70-9232-41a7-b2fa-b3d7a2eea627 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:36.021972 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:36.054847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc94c4-fda6-4a64-9586-360d365e15b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:36.055539 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc94c4-fda6-4a64-9586-360d365e15b6 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:36.055824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc94c4-fda6-4a64-9586-360d365e15b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:36.057026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc94c4-fda6-4a64-9586-360d365e15b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:36.057026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc94c4-fda6-4a64-9586-360d365e15b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:36.057391 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc94c4-fda6-4a64-9586-360d365e15b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:36.058791 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc94c4-fda6-4a64-9586-360d365e15b6 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:36.069946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 182/355] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:36.072524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc94c4-fda6-4a64-9586-360d365e15b6 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:36.105470 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a950efa-d836-4e0e-b5a5-a14dc78e3c12 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:36.130215 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:36.152231 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758a150-3093-4404-8ed4-d63fb0d55974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:36.153337 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758a150-3093-4404-8ed4-d63fb0d55974 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:36.153760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758a150-3093-4404-8ed4-d63fb0d55974 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:36.155001 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758a150-3093-4404-8ed4-d63fb0d55974 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:36.156393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758a150-3093-4404-8ed4-d63fb0d55974 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:36.157994 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758a150-3093-4404-8ed4-d63fb0d55974 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:36.159851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 174/356] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:35 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:36.162086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ba08e-7d58-419e-b37a-640c5d82b302 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:36.162390 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ba08e-7d58-419e-b37a-640c5d82b302 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:36.163038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ba08e-7d58-419e-b37a-640c5d82b302 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:36.164248 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 175/357] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:36.164964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ba08e-7d58-419e-b37a-640c5d82b302 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:36.211956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc94c4-fda6-4a64-9586-360d365e15b6 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:36.259233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851a768-2050-4f50-af8e-2995ac79a26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:36.261197 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851a768-2050-4f50-af8e-2995ac79a26b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:36.261441 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851a768-2050-4f50-af8e-2995ac79a26b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:36.261677 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851a768-2050-4f50-af8e-2995ac79a26b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:36.277872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851a768-2050-4f50-af8e-2995ac79a26b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-1851a768-2050-4f50-af8e-2995ac79a26b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:36.287030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:36.287990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:36.289308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 183/358] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:36.289993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851a768-2050-4f50-af8e-2995ac79a26b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:36.305248 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ba08e-7d58-419e-b37a-640c5d82b302 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:36.348009 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:36.354002 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e527e2-317c-4cd6-b942-bf5dc1267011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:36.354975 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e527e2-317c-4cd6-b942-bf5dc1267011 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:36.355265 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e527e2-317c-4cd6-b942-bf5dc1267011 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:36.355595 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e527e2-317c-4cd6-b942-bf5dc1267011 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:36.370437 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e527e2-317c-4cd6-b942-bf5dc1267011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-b3e527e2-317c-4cd6-b942-bf5dc1267011 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:36.384099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:36.385255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 176/359] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:40:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:36.387398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e527e2-317c-4cd6-b942-bf5dc1267011 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:36.460248 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:36.462736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851a768-2050-4f50-af8e-2995ac79a26b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:36.521818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385196ea-cd82-4a16-ba6e-aa535a36f470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:36.522738 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385196ea-cd82-4a16-ba6e-aa535a36f470 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:36.523159 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385196ea-cd82-4a16-ba6e-aa535a36f470 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:36.523604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385196ea-cd82-4a16-ba6e-aa535a36f470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:36.536247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e527e2-317c-4cd6-b942-bf5dc1267011 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:36.579696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a55c5f-a0f0-4c57-b0b7-a4f842b0ab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:36.580648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a55c5f-a0f0-4c57-b0b7-a4f842b0ab8b None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:36.580931 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a55c5f-a0f0-4c57-b0b7-a4f842b0ab8b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:36.581210 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a55c5f-a0f0-4c57-b0b7-a4f842b0ab8b None admin] PATH_INFO: `/v3/groups/72719c57e37a4eba89ab83e908f4f61c` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:36.585163 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a55c5f-a0f0-4c57-b0b7-a4f842b0ab8b None admin] RBAC: Authorizing `identity:get_group(group_id=72719c57e37a4eba89ab83e908f4f61c)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:36.587429 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a55c5f-a0f0-4c57-b0b7-a4f842b0ab8b None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:36.589559 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 177/360] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:36 2022] GET /identity/v3/groups/72719c57e37a4eba89ab83e908f4f61c => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:36.594038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaeaa5b-a552-49e6-9161-cf3df7208c93 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:36.594550 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaeaa5b-a552-49e6-9161-cf3df7208c93 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:36.595046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaeaa5b-a552-49e6-9161-cf3df7208c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:36.615790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-cbaeaa5b-a552-49e6-9161-cf3df7208c93 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:36.617349 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-cbaeaa5b-a552-49e6-9161-cf3df7208c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:36.618426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385196ea-cd82-4a16-ba6e-aa535a36f470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:36.620136 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385196ea-cd82-4a16-ba6e-aa535a36f470 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:36.668436 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:36.704974 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 178/361] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:36.706910 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaeaa5b-a552-49e6-9161-cf3df7208c93 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:36.767151 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:36.768883 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 184/362] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:36.770612 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385196ea-cd82-4a16-ba6e-aa535a36f470 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:36.849973 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaeaa5b-a552-49e6-9161-cf3df7208c93 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:36.896012 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d044e13-fa2c-49e7-b537-bfc820cdc595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:36.897370 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385196ea-cd82-4a16-ba6e-aa535a36f470 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:36.898535 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d044e13-fa2c-49e7-b537-bfc820cdc595 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:36.898844 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d044e13-fa2c-49e7-b537-bfc820cdc595 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:36.899184 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d044e13-fa2c-49e7-b537-bfc820cdc595 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:36.899967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d044e13-fa2c-49e7-b537-bfc820cdc595 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:36.900338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d044e13-fa2c-49e7-b537-bfc820cdc595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:36.901768 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d044e13-fa2c-49e7-b537-bfc820cdc595 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:36.913032 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 179/363] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:36.913717 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d044e13-fa2c-49e7-b537-bfc820cdc595 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:36.948659 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69884ce0-e423-4a55-8aac-3125947b2946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:36.949744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884ce0-e423-4a55-8aac-3125947b2946 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:36.950241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884ce0-e423-4a55-8aac-3125947b2946 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:36.950827 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884ce0-e423-4a55-8aac-3125947b2946 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:36.952095 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69884ce0-e423-4a55-8aac-3125947b2946 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:36.952440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69884ce0-e423-4a55-8aac-3125947b2946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:36.953887 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69884ce0-e423-4a55-8aac-3125947b2946 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:36.957498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:36.968702 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 185/364] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:36.970701 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69884ce0-e423-4a55-8aac-3125947b2946 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:37.072647 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d044e13-fa2c-49e7-b537-bfc820cdc595 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:37.076697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:37.117972 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf1be6-fa85-4633-ae9a-570d560aaf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:37.118658 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf1be6-fa85-4633-ae9a-570d560aaf57 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:37.119479 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf1be6-fa85-4633-ae9a-570d560aaf57 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:37.119479 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf1be6-fa85-4633-ae9a-570d560aaf57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:37.120051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf1be6-fa85-4633-ae9a-570d560aaf57 None admin] RBAC: Adding query filter params (group.id=72719c57e37a4eba89ab83e908f4f61c, role.id=97e1bde6953846e0b3e2204a9aa8868d, scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:37.120400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf1be6-fa85-4633-ae9a-570d560aaf57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:37.121883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf1be6-fa85-4633-ae9a-570d560aaf57 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:37.129830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 180/365] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 13:40:36 2022] GET /identity/v3/role_assignments?group.id=72719c57e37a4eba89ab83e908f4f61c&scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0&role.id=97e1bde6953846e0b3e2204a9aa8868d => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:37.131212 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf1be6-fa85-4633-ae9a-570d560aaf57 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:37.137183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69884ce0-e423-4a55-8aac-3125947b2946 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:37.185133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58043170-13be-4f34-8778-38bf0a41b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:37.187230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58043170-13be-4f34-8778-38bf0a41b47b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:37.187578 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58043170-13be-4f34-8778-38bf0a41b47b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:37.187863 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58043170-13be-4f34-8778-38bf0a41b47b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:37.207936 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58043170-13be-4f34-8778-38bf0a41b47b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-58043170-13be-4f34-8778-38bf0a41b47b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:37.219562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:37.220574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:37.221371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 186/366] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:37.222814 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58043170-13be-4f34-8778-38bf0a41b47b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:37.290117 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf1be6-fa85-4633-ae9a-570d560aaf57 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:37.339810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68382776-78ac-4c2c-9de2-9eeecae09f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:37.340728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68382776-78ac-4c2c-9de2-9eeecae09f26 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:37.341025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68382776-78ac-4c2c-9de2-9eeecae09f26 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:37.341729 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68382776-78ac-4c2c-9de2-9eeecae09f26 None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:37.343833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68382776-78ac-4c2c-9de2-9eeecae09f26 None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:37.345766 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68382776-78ac-4c2c-9de2-9eeecae09f26 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:37.347468 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:37.349735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 181/367] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:37 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:37.350898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68382776-78ac-4c2c-9de2-9eeecae09f26 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:37.416821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:37.431708 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58043170-13be-4f34-8778-38bf0a41b47b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:37.477309 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab356a8-79e8-4cb2-99dc-13dc794c8ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:37.478449 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab356a8-79e8-4cb2-99dc-13dc794c8ca8 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:37.478900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab356a8-79e8-4cb2-99dc-13dc794c8ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:37.479305 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab356a8-79e8-4cb2-99dc-13dc794c8ca8 None admin] PATH_INFO: `/v3/users/b642fb3dc2a14f9d90b0049618d8aa34` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:37.480772 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab356a8-79e8-4cb2-99dc-13dc794c8ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=b642fb3dc2a14f9d90b0049618d8aa34)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:37.483017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab356a8-79e8-4cb2-99dc-13dc794c8ca8 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:37.485407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 187/368] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:40:37 2022] GET /identity/v3/users/b642fb3dc2a14f9d90b0049618d8aa34 => generated 293 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:37.486020 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab356a8-79e8-4cb2-99dc-13dc794c8ca8 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:37.506215 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68382776-78ac-4c2c-9de2-9eeecae09f26 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:37.559922 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3edfd-8aa2-4c9c-a270-31d996ff6f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:37.561266 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3edfd-8aa2-4c9c-a270-31d996ff6f95 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:37.561619 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3edfd-8aa2-4c9c-a270-31d996ff6f95 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:37.561960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3edfd-8aa2-4c9c-a270-31d996ff6f95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:37.618234 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab356a8-79e8-4cb2-99dc-13dc794c8ca8 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:37.646075 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3edfd-8aa2-4c9c-a270-31d996ff6f95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:37.647683 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3edfd-8aa2-4c9c-a270-31d996ff6f95 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:37.648062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:37.659649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fe042-2e87-4ccb-8839-b46127beb317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:37.660370 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe042-2e87-4ccb-8839-b46127beb317 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:37.660660 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe042-2e87-4ccb-8839-b46127beb317 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:37.660940 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe042-2e87-4ccb-8839-b46127beb317 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:37.661712 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fe042-2e87-4ccb-8839-b46127beb317 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:37.662029 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fe042-2e87-4ccb-8839-b46127beb317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:37.663442 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fe042-2e87-4ccb-8839-b46127beb317 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:37.679815 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 188/369] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:37.679815 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fe042-2e87-4ccb-8839-b46127beb317 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:37.709598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:37.794199 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 182/370] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:37.795595 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3edfd-8aa2-4c9c-a270-31d996ff6f95 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:37.797929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fe042-2e87-4ccb-8839-b46127beb317 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:37.848138 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e6c1e-6e24-4120-8347-786dad986250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:37.849307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e6c1e-6e24-4120-8347-786dad986250 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:37.849603 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e6c1e-6e24-4120-8347-786dad986250 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:37.849882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e6c1e-6e24-4120-8347-786dad986250 None admin] PATH_INFO: `/v3/groups/72719c57e37a4eba89ab83e908f4f61c` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:37.851351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e6c1e-6e24-4120-8347-786dad986250 None admin] RBAC: Authorizing `identity:get_group(group_id=72719c57e37a4eba89ab83e908f4f61c)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:37.853754 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e6c1e-6e24-4120-8347-786dad986250 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:37.856220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 189/371] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:37 2022] GET /identity/v3/groups/72719c57e37a4eba89ab83e908f4f61c => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:37.857525 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e6c1e-6e24-4120-8347-786dad986250 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:37.919180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3edfd-8aa2-4c9c-a270-31d996ff6f95 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:37.931080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:37.966089 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9317bf1-40ec-4e2f-8aec-53d6232f6bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:37.967748 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317bf1-40ec-4e2f-8aec-53d6232f6bc3 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:37.968319 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317bf1-40ec-4e2f-8aec-53d6232f6bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:37.968796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317bf1-40ec-4e2f-8aec-53d6232f6bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:37.969843 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9317bf1-40ec-4e2f-8aec-53d6232f6bc3 None admin] RBAC: Adding query filter params (role.id=ef38bd64ddca4058879ee2f751de5470, user.id=b642fb3dc2a14f9d90b0049618d8aa34, scope.system=all) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:37.970382 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9317bf1-40ec-4e2f-8aec-53d6232f6bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:37.972039 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9317bf1-40ec-4e2f-8aec-53d6232f6bc3 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:37.975473 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:37.989258 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 183/372] 10.222.0.24 () {56 vars in 1308 bytes} [Wed May 25 13:40:37 2022] GET /identity/v3/role_assignments?user.id=b642fb3dc2a14f9d90b0049618d8aa34&scope.system=all&role.id=ef38bd64ddca4058879ee2f751de5470 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:37.990578 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9317bf1-40ec-4e2f-8aec-53d6232f6bc3 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:37.996064 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e6c1e-6e24-4120-8347-786dad986250 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:38.048107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf71ffb-0cbc-443c-8e2f-2bbe4cb70fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:38.048779 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf71ffb-0cbc-443c-8e2f-2bbe4cb70fc4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:38.049074 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf71ffb-0cbc-443c-8e2f-2bbe4cb70fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:38.049353 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf71ffb-0cbc-443c-8e2f-2bbe4cb70fc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:38.109387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9317bf1-40ec-4e2f-8aec-53d6232f6bc3 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:38.160246 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624abbd9-f51d-4619-99c9-e2a689436c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:38.161537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624abbd9-f51d-4619-99c9-e2a689436c53 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:38.162031 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624abbd9-f51d-4619-99c9-e2a689436c53 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:38.162508 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624abbd9-f51d-4619-99c9-e2a689436c53 None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:38.164322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624abbd9-f51d-4619-99c9-e2a689436c53 None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:38.166102 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624abbd9-f51d-4619-99c9-e2a689436c53 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:38.171476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 184/373] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:37 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:38.172723 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624abbd9-f51d-4619-99c9-e2a689436c53 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:38.202014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf71ffb-0cbc-443c-8e2f-2bbe4cb70fc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:38.203878 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf71ffb-0cbc-443c-8e2f-2bbe4cb70fc4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:38.280503 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:38.289570 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:38.326583 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624abbd9-f51d-4619-99c9-e2a689436c53 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:38.339168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 190/374] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:38.340169 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf71ffb-0cbc-443c-8e2f-2bbe4cb70fc4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:38.380200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8c236-94c3-4ccb-b9fa-2787a20f9b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:38.381286 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8c236-94c3-4ccb-b9fa-2787a20f9b53 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:38.381837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8c236-94c3-4ccb-b9fa-2787a20f9b53 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:38.382309 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8c236-94c3-4ccb-b9fa-2787a20f9b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:38.383836 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8c236-94c3-4ccb-b9fa-2787a20f9b53 None admin] RBAC: Adding query filter params (group.id=72719c57e37a4eba89ab83e908f4f61c, role.id=4a110f9a625548a990ed70fad43f73b0, scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:38.384359 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8c236-94c3-4ccb-b9fa-2787a20f9b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:38.386776 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8c236-94c3-4ccb-b9fa-2787a20f9b53 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:38.398584 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 185/375] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 13:40:38 2022] GET /identity/v3/role_assignments?group.id=72719c57e37a4eba89ab83e908f4f61c&scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc&role.id=4a110f9a625548a990ed70fad43f73b0 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:38.400782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5333b6-dd3b-45dd-a113-d9f21e5cf01f None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:38.401210 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5333b6-dd3b-45dd-a113-d9f21e5cf01f None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:38.401725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5333b6-dd3b-45dd-a113-d9f21e5cf01f None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:38.405238 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 186/376] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:38.406164 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5333b6-dd3b-45dd-a113-d9f21e5cf01f None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:38.492261 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf71ffb-0cbc-443c-8e2f-2bbe4cb70fc4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:38.554867 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b219c6-7d78-42c3-9bc6-dfce58f85576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:38.555767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b219c6-7d78-42c3-9bc6-dfce58f85576 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:38.556055 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b219c6-7d78-42c3-9bc6-dfce58f85576 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:38.556397 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b219c6-7d78-42c3-9bc6-dfce58f85576 None admin] PATH_INFO: `/v3/groups/72719c57e37a4eba89ab83e908f4f61c` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:38.560306 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b219c6-7d78-42c3-9bc6-dfce58f85576 None admin] RBAC: Authorizing `identity:get_group(group_id=72719c57e37a4eba89ab83e908f4f61c)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:38.561828 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b219c6-7d78-42c3-9bc6-dfce58f85576 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:38.563889 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 191/377] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:38 2022] GET /identity/v3/groups/72719c57e37a4eba89ab83e908f4f61c => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:38.564409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5333b6-dd3b-45dd-a113-d9f21e5cf01f None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:38.565287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b08bf4-cd0a-4421-b701-121f2c4d269a None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:38.565572 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b08bf4-cd0a-4421-b701-121f2c4d269a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:38.565851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b08bf4-cd0a-4421-b701-121f2c4d269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:38.585687 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-87b08bf4-cd0a-4421-b701-121f2c4d269a None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:38.586912 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-87b08bf4-cd0a-4421-b701-121f2c4d269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:38.597623 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:38.609668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:38.610507 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3825f3-d5a2-4196-9f39-aced55615999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:38.611808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3825f3-d5a2-4196-9f39-aced55615999 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:38.612456 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3825f3-d5a2-4196-9f39-aced55615999 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:38.612947 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3825f3-d5a2-4196-9f39-aced55615999 None admin] PATH_INFO: `/v3/projects/909371a65bb348a1b58a2f6624e12486` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:38.615305 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3825f3-d5a2-4196-9f39-aced55615999 None admin] RBAC: Authorizing `identity:get_project(project_id=909371a65bb348a1b58a2f6624e12486)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:38.617191 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3825f3-d5a2-4196-9f39-aced55615999 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:38.619707 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 187/378] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:38 2022] GET /identity/v3/projects/909371a65bb348a1b58a2f6624e12486 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:38.620814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3825f3-d5a2-4196-9f39-aced55615999 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:38.675808 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 192/379] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:38.676737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b08bf4-cd0a-4421-b701-121f2c4d269a None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:38.759164 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3825f3-d5a2-4196-9f39-aced55615999 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:38.808396 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a62045-b5a6-4d20-8a95-d9974b47e359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:38.809168 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a62045-b5a6-4d20-8a95-d9974b47e359 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:38.809558 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a62045-b5a6-4d20-8a95-d9974b47e359 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:38.809976 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a62045-b5a6-4d20-8a95-d9974b47e359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:38.811818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a62045-b5a6-4d20-8a95-d9974b47e359 None admin] RBAC: Adding query filter params (group.id=72719c57e37a4eba89ab83e908f4f61c, role.id=97e1bde6953846e0b3e2204a9aa8868d, scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:38.812291 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a62045-b5a6-4d20-8a95-d9974b47e359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:38.814132 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a62045-b5a6-4d20-8a95-d9974b47e359 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:38.814868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b08bf4-cd0a-4421-b701-121f2c4d269a None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:38.821985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 188/380] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 13:40:38 2022] GET /identity/v3/role_assignments?group.id=72719c57e37a4eba89ab83e908f4f61c&scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc&role.id=97e1bde6953846e0b3e2204a9aa8868d => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:38.823025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a62045-b5a6-4d20-8a95-d9974b47e359 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:38.908934 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33895503-7d41-4b40-89d4-aff227614152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:38.910076 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33895503-7d41-4b40-89d4-aff227614152 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:38.910644 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33895503-7d41-4b40-89d4-aff227614152 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:38.911073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33895503-7d41-4b40-89d4-aff227614152 None admin] PATH_INFO: `/v3/groups/2cec0c78435d443b94ef03f75ef4a6e1` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:38.915049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:38.948914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33895503-7d41-4b40-89d4-aff227614152 None admin] RBAC: Authorizing `identity:get_group(group_id=2cec0c78435d443b94ef03f75ef4a6e1)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:38.950443 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33895503-7d41-4b40-89d4-aff227614152 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:38.953286 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 193/381] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:38 2022] GET /identity/v3/groups/2cec0c78435d443b94ef03f75ef4a6e1 => generated 229 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:38.959002 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33895503-7d41-4b40-89d4-aff227614152 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:38.982106 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a62045-b5a6-4d20-8a95-d9974b47e359 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:39.003086 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:39.057143 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68ceb7-b3cc-4ee2-bb4f-f0d280fd26b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:39.058358 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68ceb7-b3cc-4ee2-bb4f-f0d280fd26b0 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:39.058857 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68ceb7-b3cc-4ee2-bb4f-f0d280fd26b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:39.059327 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68ceb7-b3cc-4ee2-bb4f-f0d280fd26b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:39.071649 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68ceb7-b3cc-4ee2-bb4f-f0d280fd26b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-dc68ceb7-b3cc-4ee2-bb4f-f0d280fd26b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:39.082949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:39.083896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:39.084703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:39.084703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:39.084703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:39.084703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:39.084703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:39.084703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:39.084703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:39.084703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:39.084703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:39.084703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:39.084703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:39.084703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:39.087074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 189/382] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:39.093124 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68ceb7-b3cc-4ee2-bb4f-f0d280fd26b0 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:39.115356 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33895503-7d41-4b40-89d4-aff227614152 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:39.155485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e9bf7-3099-4bc0-b607-e1944dfe3346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:39.156182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e9bf7-3099-4bc0-b607-e1944dfe3346 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:39.156472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e9bf7-3099-4bc0-b607-e1944dfe3346 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:39.156835 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e9bf7-3099-4bc0-b607-e1944dfe3346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:39.157592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e9bf7-3099-4bc0-b607-e1944dfe3346 None admin] RBAC: Adding query filter params (group.id=2cec0c78435d443b94ef03f75ef4a6e1, role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=909371a65bb348a1b58a2f6624e12486) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:39.157907 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e9bf7-3099-4bc0-b607-e1944dfe3346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:39.159774 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e9bf7-3099-4bc0-b607-e1944dfe3346 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:39.167521 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 194/383] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 13:40:38 2022] GET /identity/v3/role_assignments?group.id=2cec0c78435d443b94ef03f75ef4a6e1&scope.project.id=909371a65bb348a1b58a2f6624e12486&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:39.205638 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68ceb7-b3cc-4ee2-bb4f-f0d280fd26b0 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:39.225964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:39.245084 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ccf81-0bd7-4739-907f-fb0a20d0ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:39.246155 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ccf81-0bd7-4739-907f-fb0a20d0ef63 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:39.246667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ccf81-0bd7-4739-907f-fb0a20d0ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:39.247138 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ccf81-0bd7-4739-907f-fb0a20d0ef63 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:39.249037 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ccf81-0bd7-4739-907f-fb0a20d0ef63 None admin] RBAC: Adding query filter params (name=member) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:39.249603 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ccf81-0bd7-4739-907f-fb0a20d0ef63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:39.251286 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ccf81-0bd7-4739-907f-fb0a20d0ef63 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:39.261264 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 190/384] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:39.267943 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e9bf7-3099-4bc0-b607-e1944dfe3346 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:39.390534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:39.426162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e9bf7-3099-4bc0-b607-e1944dfe3346 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:39.493459 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ca90c-2b74-4406-ac17-96b9bf839519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:39.494407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ca90c-2b74-4406-ac17-96b9bf839519 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:39.494694 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ca90c-2b74-4406-ac17-96b9bf839519 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:39.494969 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ca90c-2b74-4406-ac17-96b9bf839519 None admin] PATH_INFO: `/v3/groups/72719c57e37a4eba89ab83e908f4f61c` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:39.500935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ca90c-2b74-4406-ac17-96b9bf839519 None admin] RBAC: Authorizing `identity:get_group(group_id=72719c57e37a4eba89ab83e908f4f61c)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:39.502436 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ca90c-2b74-4406-ac17-96b9bf839519 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:39.504352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 195/385] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:39 2022] GET /identity/v3/groups/72719c57e37a4eba89ab83e908f4f61c => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:39.509994 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ccf81-0bd7-4739-907f-fb0a20d0ef63 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:39.669619 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ccf81-0bd7-4739-907f-fb0a20d0ef63 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:39.722842 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d1e2d-e48e-44ad-8b37-cf86aa9601dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:39.724089 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d1e2d-e48e-44ad-8b37-cf86aa9601dc None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:39.724622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d1e2d-e48e-44ad-8b37-cf86aa9601dc None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:39.725101 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d1e2d-e48e-44ad-8b37-cf86aa9601dc None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:39.726558 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d1e2d-e48e-44ad-8b37-cf86aa9601dc None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:39.728497 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d1e2d-e48e-44ad-8b37-cf86aa9601dc None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:39.730825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 191/386] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:39 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:39.737243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ca90c-2b74-4406-ac17-96b9bf839519 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:39.883485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ca90c-2b74-4406-ac17-96b9bf839519 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:39.920518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a823d-0638-4240-8550-f83a017235c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:39.921414 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a823d-0638-4240-8550-f83a017235c1 None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:39.921758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a823d-0638-4240-8550-f83a017235c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:39.922038 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a823d-0638-4240-8550-f83a017235c1 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0/groups/72719c57e37a4eba89ab83e908f4f61c/roles/4a110f9a625548a990ed70fad43f73b0` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:39.924175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a823d-0638-4240-8550-f83a017235c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0baa23d9f8e4a49ad2b6910b32414a0, group_id=72719c57e37a4eba89ab83e908f4f61c, role_id=4a110f9a625548a990ed70fad43f73b0)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:39.925636 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a823d-0638-4240-8550-f83a017235c1 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:39.942016 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 196/387] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 13:40:39 2022] PUT /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0/groups/72719c57e37a4eba89ab83e908f4f61c/roles/4a110f9a625548a990ed70fad43f73b0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:40.001564 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6644f-cb27-4bc5-94c7-fa674b672ab6 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:40.002071 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6644f-cb27-4bc5-94c7-fa674b672ab6 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:40.002254 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6644f-cb27-4bc5-94c7-fa674b672ab6 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:40.004186 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 192/388] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:40.010231 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916f45-5d56-4a6d-97e2-fb2f8562a43e None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:40.010753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916f45-5d56-4a6d-97e2-fb2f8562a43e None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:40.010947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916f45-5d56-4a6d-97e2-fb2f8562a43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:40.030271 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-f3916f45-5d56-4a6d-97e2-fb2f8562a43e None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:40.031570 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-f3916f45-5d56-4a6d-97e2-fb2f8562a43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:40.034932 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:40.110987 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 197/389] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:40.134546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6644f-cb27-4bc5-94c7-fa674b672ab6 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:40.203195 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:40.267188 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6644f-cb27-4bc5-94c7-fa674b672ab6 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:40.312131 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad7cc8-43be-4ff0-917c-d3f3aadf5290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:40.312958 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad7cc8-43be-4ff0-917c-d3f3aadf5290 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:40.313294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad7cc8-43be-4ff0-917c-d3f3aadf5290 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:40.313578 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad7cc8-43be-4ff0-917c-d3f3aadf5290 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:40.329204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad7cc8-43be-4ff0-917c-d3f3aadf5290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-6fad7cc8-43be-4ff0-917c-d3f3aadf5290 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:40.337624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:40.338601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:40.339388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 193/390] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:40:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:40.346360 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3916f45-5d56-4a6d-97e2-fb2f8562a43e None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:40.465054 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3916f45-5d56-4a6d-97e2-fb2f8562a43e None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:40.502083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80d94b-ae2f-4d84-836e-1504fa443d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:40.502773 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80d94b-ae2f-4d84-836e-1504fa443d8f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:40.503060 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80d94b-ae2f-4d84-836e-1504fa443d8f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:40.503337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80d94b-ae2f-4d84-836e-1504fa443d8f None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:40.504197 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80d94b-ae2f-4d84-836e-1504fa443d8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:40.504510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80d94b-ae2f-4d84-836e-1504fa443d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:40.505986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80d94b-ae2f-4d84-836e-1504fa443d8f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:40.515738 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 198/391] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:40.524169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad7cc8-43be-4ff0-917c-d3f3aadf5290 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:40.697950 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad7cc8-43be-4ff0-917c-d3f3aadf5290 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:40.723194 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:40.756323 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454605f-08fc-475f-b8c9-1583f11b4f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:40.757211 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454605f-08fc-475f-b8c9-1583f11b4f9c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:40.757500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454605f-08fc-475f-b8c9-1583f11b4f9c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:40.757781 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454605f-08fc-475f-b8c9-1583f11b4f9c None admin] PATH_INFO: `/v3/groups/72719c57e37a4eba89ab83e908f4f61c` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:40.759087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454605f-08fc-475f-b8c9-1583f11b4f9c None admin] RBAC: Authorizing `identity:get_group(group_id=72719c57e37a4eba89ab83e908f4f61c)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:40.760622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454605f-08fc-475f-b8c9-1583f11b4f9c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:40.762710 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 194/392] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:40 2022] GET /identity/v3/groups/72719c57e37a4eba89ab83e908f4f61c => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:40.773397 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80d94b-ae2f-4d84-836e-1504fa443d8f None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:40.784221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:40.951405 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80d94b-ae2f-4d84-836e-1504fa443d8f None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:40.989869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981e317-ae5c-44c6-a03f-bdbae9367d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:40.990757 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981e317-ae5c-44c6-a03f-bdbae9367d11 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:40.991039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981e317-ae5c-44c6-a03f-bdbae9367d11 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:40.991310 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981e317-ae5c-44c6-a03f-bdbae9367d11 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:40.992669 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981e317-ae5c-44c6-a03f-bdbae9367d11 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:40.994194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981e317-ae5c-44c6-a03f-bdbae9367d11 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:40.996378 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 199/393] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:40 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:41.002668 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454605f-08fc-475f-b8c9-1583f11b4f9c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:41.126448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454605f-08fc-475f-b8c9-1583f11b4f9c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:41.161828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299c201-b267-46bf-bc31-32206e968ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:41.162709 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299c201-b267-46bf-bc31-32206e968ecd None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:41.162986 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299c201-b267-46bf-bc31-32206e968ecd None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:41.163254 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299c201-b267-46bf-bc31-32206e968ecd None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0/groups/72719c57e37a4eba89ab83e908f4f61c/roles/97e1bde6953846e0b3e2204a9aa8868d` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:41.165522 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299c201-b267-46bf-bc31-32206e968ecd None admin] RBAC: Authorizing `identity:create_grant(project_id=c0baa23d9f8e4a49ad2b6910b32414a0, group_id=72719c57e37a4eba89ab83e908f4f61c, role_id=97e1bde6953846e0b3e2204a9aa8868d)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:41.166959 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299c201-b267-46bf-bc31-32206e968ecd None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:41.188286 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 195/394] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 13:40:41 2022] PUT /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0/groups/72719c57e37a4eba89ab83e908f4f61c/roles/97e1bde6953846e0b3e2204a9aa8868d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:40:41.305477 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed456a1b-156e-4699-82f8-f68823c5f772 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:41.308253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed456a1b-156e-4699-82f8-f68823c5f772 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:41.308253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed456a1b-156e-4699-82f8-f68823c5f772 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:41.308253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 200/395] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:41.314635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9d331-b8ce-4e98-9d83-26841d6951d5 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:41.314926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9d331-b8ce-4e98-9d83-26841d6951d5 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:41.315204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9d331-b8ce-4e98-9d83-26841d6951d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:41.334198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-30c9d331-b8ce-4e98-9d83-26841d6951d5 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:41.335491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-30c9d331-b8ce-4e98-9d83-26841d6951d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:41.370975 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:41.426698 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 196/396] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:41.461944 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed456a1b-156e-4699-82f8-f68823c5f772 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:41.540263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:41.577112 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed456a1b-156e-4699-82f8-f68823c5f772 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:41.617229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7746a-772b-4914-b75d-99da7d3c7374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:41.618468 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7746a-772b-4914-b75d-99da7d3c7374 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:41.618964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7746a-772b-4914-b75d-99da7d3c7374 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:41.619451 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7746a-772b-4914-b75d-99da7d3c7374 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:41.641207 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7746a-772b-4914-b75d-99da7d3c7374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-b2b7746a-772b-4914-b75d-99da7d3c7374 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:41.649556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:41.650424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:41.651204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:41.651204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:41.651204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:41.651204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:41.651204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:41.651204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:41.651204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:41.651204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:41.651204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:41.651204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:41.651204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:41.651204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:41.660568 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 201/397] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:41.669791 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9d331-b8ce-4e98-9d83-26841d6951d5 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:41.824984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9d331-b8ce-4e98-9d83-26841d6951d5 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:41.876589 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1087310-5860-4300-8cd0-f37fa7410121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:41.878192 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1087310-5860-4300-8cd0-f37fa7410121 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:41.879066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1087310-5860-4300-8cd0-f37fa7410121 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:41.879874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1087310-5860-4300-8cd0-f37fa7410121 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:41.880974 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1087310-5860-4300-8cd0-f37fa7410121 None admin] RBAC: Adding query filter params (name=member) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:41.881513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1087310-5860-4300-8cd0-f37fa7410121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:41.883158 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1087310-5860-4300-8cd0-f37fa7410121 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:41.906661 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 197/398] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:41.912075 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7746a-772b-4914-b75d-99da7d3c7374 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:42.052989 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7746a-772b-4914-b75d-99da7d3c7374 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:42.057384 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0f91e-1851-4e7c-b0e8-22a542652306 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.058277 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0f91e-1851-4e7c-b0e8-22a542652306 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.058780 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0f91e-1851-4e7c-b0e8-22a542652306 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.060914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 198/399] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:42.067441 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8e283-eb54-48e9-81a9-95b8d2bbdc10 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.068018 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8e283-eb54-48e9-81a9-95b8d2bbdc10 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.068515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8e283-eb54-48e9-81a9-95b8d2bbdc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.088626 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-32f8e283-eb54-48e9-81a9-95b8d2bbdc10 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:42.090181 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-32f8e283-eb54-48e9-81a9-95b8d2bbdc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:42.108499 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:42.116198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06764fc2-4be4-44ed-af3b-b805ab36f63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:42.117073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764fc2-4be4-44ed-af3b-b805ab36f63d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.117361 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764fc2-4be4-44ed-af3b-b805ab36f63d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.117640 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764fc2-4be4-44ed-af3b-b805ab36f63d None admin] PATH_INFO: `/v3/groups/72719c57e37a4eba89ab83e908f4f61c` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.118826 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06764fc2-4be4-44ed-af3b-b805ab36f63d None admin] RBAC: Authorizing `identity:get_group(group_id=72719c57e37a4eba89ab83e908f4f61c)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:42.120330 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06764fc2-4be4-44ed-af3b-b805ab36f63d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:42.122805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:42.122936 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 202/400] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:41 2022] GET /identity/v3/groups/72719c57e37a4eba89ab83e908f4f61c => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:42.124253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568b752-26a4-4a36-9323-8949f1df5c73 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.124550 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568b752-26a4-4a36-9323-8949f1df5c73 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.124828 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568b752-26a4-4a36-9323-8949f1df5c73 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.126366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 203/401] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:42.131010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568b752-26a4-4a36-9323-8949f1df5c73 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:42.171967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 199/402] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:42.181217 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58809875-c24a-4e65-aaed-36377fc52fb9 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.181505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58809875-c24a-4e65-aaed-36377fc52fb9 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.181967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58809875-c24a-4e65-aaed-36377fc52fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.206252 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-58809875-c24a-4e65-aaed-36377fc52fb9 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:42.207743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-58809875-c24a-4e65-aaed-36377fc52fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:42.252516 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568b752-26a4-4a36-9323-8949f1df5c73 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:42.283545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 200/403] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:42.284735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58809875-c24a-4e65-aaed-36377fc52fb9 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:42.308982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07822c23-1377-4d18-9293-7e20088ee76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:42.310339 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822c23-1377-4d18-9293-7e20088ee76c None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.310645 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822c23-1377-4d18-9293-7e20088ee76c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.310925 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822c23-1377-4d18-9293-7e20088ee76c None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.313017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07822c23-1377-4d18-9293-7e20088ee76c None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:42.314332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07822c23-1377-4d18-9293-7e20088ee76c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:42.320162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 204/404] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:42 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:42.324362 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07822c23-1377-4d18-9293-7e20088ee76c None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:42.395928 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:42.398348 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:42.415283 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58809875-c24a-4e65-aaed-36377fc52fb9 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:42.436181 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07822c23-1377-4d18-9293-7e20088ee76c None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:42.455135 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08d9ca-628b-4b01-a7cc-d8a770fe34e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:42.456245 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08d9ca-628b-4b01-a7cc-d8a770fe34e3 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.456715 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08d9ca-628b-4b01-a7cc-d8a770fe34e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.457141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08d9ca-628b-4b01-a7cc-d8a770fe34e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.469440 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08d9ca-628b-4b01-a7cc-d8a770fe34e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:42.472819 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b26ef-4825-4017-9d13-54ccf663796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:42.473636 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b26ef-4825-4017-9d13-54ccf663796a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.473935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b26ef-4825-4017-9d13-54ccf663796a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.474197 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b26ef-4825-4017-9d13-54ccf663796a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-da08d9ca-628b-4b01-a7cc-d8a770fe34e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:42.479072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:42.480242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:42.481272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:42.481272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:42.481272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:42.481272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:42.481272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:42.481272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:42.481272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:42.481272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:42.481272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:42.481272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:42.481272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:42.481272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:42.484303 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 201/405] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:40:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:42.485286 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08d9ca-628b-4b01-a7cc-d8a770fe34e3 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:42.491506 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b26ef-4825-4017-9d13-54ccf663796a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-818b26ef-4825-4017-9d13-54ccf663796a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:42.500583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:42.501800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:42.502683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:42.502683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:42.502683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:42.502683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:42.502683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:42.502683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:42.502683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:42.502683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:42.502683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:42.502683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:42.502683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:42.502683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:42.506600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 205/406] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:40:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:42.507489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b26ef-4825-4017-9d13-54ccf663796a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:42.599418 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08d9ca-628b-4b01-a7cc-d8a770fe34e3 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:42.615983 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b26ef-4825-4017-9d13-54ccf663796a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:42.639338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb53ec-94e0-4113-90e2-bf742db860ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:42.640634 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb53ec-94e0-4113-90e2-bf742db860ba None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.641111 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb53ec-94e0-4113-90e2-bf742db860ba None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.641653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb53ec-94e0-4113-90e2-bf742db860ba None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc/groups/72719c57e37a4eba89ab83e908f4f61c/roles/4a110f9a625548a990ed70fad43f73b0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.644277 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb53ec-94e0-4113-90e2-bf742db860ba None admin] RBAC: Authorizing `identity:create_grant(project_id=6ad01a9f12cd4be89048efd0d4cd70cc, group_id=72719c57e37a4eba89ab83e908f4f61c, role_id=4a110f9a625548a990ed70fad43f73b0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:42.645540 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:42.648007 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb53ec-94e0-4113-90e2-bf742db860ba None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:42.657737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c37a98-7580-44fb-8256-d23787b805d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:42.658752 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c37a98-7580-44fb-8256-d23787b805d0 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.659213 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c37a98-7580-44fb-8256-d23787b805d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.659487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c37a98-7580-44fb-8256-d23787b805d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.660277 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c37a98-7580-44fb-8256-d23787b805d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:42.660716 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c37a98-7580-44fb-8256-d23787b805d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:42.662005 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c37a98-7580-44fb-8256-d23787b805d0 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:42.667026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 202/407] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 13:40:42 2022] PUT /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc/groups/72719c57e37a4eba89ab83e908f4f61c/roles/4a110f9a625548a990ed70fad43f73b0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:42.668378 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb53ec-94e0-4113-90e2-bf742db860ba None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:42.672173 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 206/408] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:42.678257 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c37a98-7580-44fb-8256-d23787b805d0 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:42.684125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:42.840509 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c37a98-7580-44fb-8256-d23787b805d0 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:42.885853 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9a179-9dcc-4138-9a85-09754d278735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:42.887278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9a179-9dcc-4138-9a85-09754d278735 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.888729 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9a179-9dcc-4138-9a85-09754d278735 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.889164 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9a179-9dcc-4138-9a85-09754d278735 None admin] PATH_INFO: `/v3/groups/2cec0c78435d443b94ef03f75ef4a6e1` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.890664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9a179-9dcc-4138-9a85-09754d278735 None admin] RBAC: Authorizing `identity:get_group(group_id=2cec0c78435d443b94ef03f75ef4a6e1)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:42.894459 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9a179-9dcc-4138-9a85-09754d278735 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:42.898648 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 207/409] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:42 2022] GET /identity/v3/groups/2cec0c78435d443b94ef03f75ef4a6e1 => generated 229 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:42.904165 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6e8f2-fceb-45b2-903e-cbdf290859a1 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.904165 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6e8f2-fceb-45b2-903e-cbdf290859a1 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.904487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6e8f2-fceb-45b2-903e-cbdf290859a1 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.905354 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb53ec-94e0-4113-90e2-bf742db860ba None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:42.906092 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 208/410] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:42.908225 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6e8f2-fceb-45b2-903e-cbdf290859a1 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:42.947619 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2dcfa-7351-4d32-a6ab-6f38402abc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:42.948403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2dcfa-7351-4d32-a6ab-6f38402abc27 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.948690 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2dcfa-7351-4d32-a6ab-6f38402abc27 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.949059 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2dcfa-7351-4d32-a6ab-6f38402abc27 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.949909 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2dcfa-7351-4d32-a6ab-6f38402abc27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:42.950219 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2dcfa-7351-4d32-a6ab-6f38402abc27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:42.951999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2dcfa-7351-4d32-a6ab-6f38402abc27 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:42.960827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 203/411] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:42.962336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619199c-5d29-4680-bab9-a6d31866c979 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:42.962470 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619199c-5d29-4680-bab9-a6d31866c979 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:42.962666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619199c-5d29-4680-bab9-a6d31866c979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:42.980890 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-e619199c-5d29-4680-bab9-a6d31866c979 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:42.982175 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-e619199c-5d29-4680-bab9-a6d31866c979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:42.984512 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:43.036094 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6e8f2-fceb-45b2-903e-cbdf290859a1 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:43.048047 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:43.052833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 204/412] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:43.053718 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619199c-5d29-4680-bab9-a6d31866c979 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:43.084944 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf923bd-63d2-4481-a364-f131ba681164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:43.087566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf923bd-63d2-4481-a364-f131ba681164 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:43.088058 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf923bd-63d2-4481-a364-f131ba681164 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:43.088939 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf923bd-63d2-4481-a364-f131ba681164 None admin] PATH_INFO: `/v3/projects/909371a65bb348a1b58a2f6624e12486` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:43.092478 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf923bd-63d2-4481-a364-f131ba681164 None admin] RBAC: Authorizing `identity:get_project(project_id=909371a65bb348a1b58a2f6624e12486)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:43.094183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf923bd-63d2-4481-a364-f131ba681164 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:43.096455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 209/413] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:42 2022] GET /identity/v3/projects/909371a65bb348a1b58a2f6624e12486 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:43.102078 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf923bd-63d2-4481-a364-f131ba681164 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:43.182743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619199c-5d29-4680-bab9-a6d31866c979 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:43.209589 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf923bd-63d2-4481-a364-f131ba681164 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:43.220154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbad06-fd59-4bca-920e-2b8b0935100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:43.220891 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbad06-fd59-4bca-920e-2b8b0935100a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:43.221184 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbad06-fd59-4bca-920e-2b8b0935100a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:43.221463 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbad06-fd59-4bca-920e-2b8b0935100a None admin] PATH_INFO: `/v3/groups/72719c57e37a4eba89ab83e908f4f61c` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:43.222793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbad06-fd59-4bca-920e-2b8b0935100a None admin] RBAC: Authorizing `identity:get_group(group_id=72719c57e37a4eba89ab83e908f4f61c)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:43.224357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbad06-fd59-4bca-920e-2b8b0935100a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:43.226235 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 205/414] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:43 2022] GET /identity/v3/groups/72719c57e37a4eba89ab83e908f4f61c => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:43.231352 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbad06-fd59-4bca-920e-2b8b0935100a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:43.248377 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:43.266689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf53567-7cd9-4f8d-84ec-8075698b8032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:43.267581 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf53567-7cd9-4f8d-84ec-8075698b8032 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:43.267909 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf53567-7cd9-4f8d-84ec-8075698b8032 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:43.268539 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf53567-7cd9-4f8d-84ec-8075698b8032 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:43.285621 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf53567-7cd9-4f8d-84ec-8075698b8032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-adf53567-7cd9-4f8d-84ec-8075698b8032 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:43.296930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:43.297910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:43.298704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 210/415] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:43.299859 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf53567-7cd9-4f8d-84ec-8075698b8032 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:43.327654 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:43.381505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbad06-fd59-4bca-920e-2b8b0935100a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:43.431436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10786519-f727-4b89-bbaa-46d835fc2498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:43.432714 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786519-f727-4b89-bbaa-46d835fc2498 None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:43.432984 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf53567-7cd9-4f8d-84ec-8075698b8032 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:43.433797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786519-f727-4b89-bbaa-46d835fc2498 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:43.434272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786519-f727-4b89-bbaa-46d835fc2498 None admin] PATH_INFO: `/v3/projects/909371a65bb348a1b58a2f6624e12486/groups/2cec0c78435d443b94ef03f75ef4a6e1/roles/109ea861e27e4d75bec3ac9c5f81096e` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:43.437588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10786519-f727-4b89-bbaa-46d835fc2498 None admin] RBAC: Authorizing `identity:create_grant(project_id=909371a65bb348a1b58a2f6624e12486, group_id=2cec0c78435d443b94ef03f75ef4a6e1, role_id=109ea861e27e4d75bec3ac9c5f81096e)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:43.439330 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10786519-f727-4b89-bbaa-46d835fc2498 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:43.464755 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 206/416] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 13:40:43 2022] PUT /identity/v3/projects/909371a65bb348a1b58a2f6624e12486/groups/2cec0c78435d443b94ef03f75ef4a6e1/roles/109ea861e27e4d75bec3ac9c5f81096e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:43.464755 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10786519-f727-4b89-bbaa-46d835fc2498 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:43.499160 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd804508-88b8-4d07-acf2-0991fb0377e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:43.500123 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd804508-88b8-4d07-acf2-0991fb0377e6 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:43.500413 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd804508-88b8-4d07-acf2-0991fb0377e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:43.500697 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd804508-88b8-4d07-acf2-0991fb0377e6 None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:43.505568 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd804508-88b8-4d07-acf2-0991fb0377e6 None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:43.508375 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd804508-88b8-4d07-acf2-0991fb0377e6 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:43.516433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 211/417] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:43 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:43.522658 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd804508-88b8-4d07-acf2-0991fb0377e6 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:43.653171 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:43.657285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10786519-f727-4b89-bbaa-46d835fc2498 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:43.701840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:43.717392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0cf36-2d67-408e-b921-947afa137dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:43.717882 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0cf36-2d67-408e-b921-947afa137dc8 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:43.720680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0cf36-2d67-408e-b921-947afa137dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:43.720680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0cf36-2d67-408e-b921-947afa137dc8 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:43.720680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0cf36-2d67-408e-b921-947afa137dc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:43.720680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0cf36-2d67-408e-b921-947afa137dc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:43.721424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0cf36-2d67-408e-b921-947afa137dc8 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:43.737239 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 207/418] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:43.742887 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0cf36-2d67-408e-b921-947afa137dc8 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:43.774840 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd804508-88b8-4d07-acf2-0991fb0377e6 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:43.829027 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96e482-c18d-4566-97f5-159b902e763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:43.830134 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e482-c18d-4566-97f5-159b902e763e None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:43.830522 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e482-c18d-4566-97f5-159b902e763e None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:43.830910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e482-c18d-4566-97f5-159b902e763e None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc/groups/72719c57e37a4eba89ab83e908f4f61c/roles/97e1bde6953846e0b3e2204a9aa8868d` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:43.833356 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96e482-c18d-4566-97f5-159b902e763e None admin] RBAC: Authorizing `identity:create_grant(project_id=6ad01a9f12cd4be89048efd0d4cd70cc, group_id=72719c57e37a4eba89ab83e908f4f61c, role_id=97e1bde6953846e0b3e2204a9aa8868d)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:43.834981 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96e482-c18d-4566-97f5-159b902e763e None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:43.855933 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 212/419] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 13:40:43 2022] PUT /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc/groups/72719c57e37a4eba89ab83e908f4f61c/roles/97e1bde6953846e0b3e2204a9aa8868d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:40:43.877132 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0cf36-2d67-408e-b921-947afa137dc8 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:43.921114 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba5595-7bcb-452b-a2a7-39585f1ec4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:43.922146 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba5595-7bcb-452b-a2a7-39585f1ec4f4 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:43.922612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba5595-7bcb-452b-a2a7-39585f1ec4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:43.923090 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba5595-7bcb-452b-a2a7-39585f1ec4f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:43.947461 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c4d3-a5df-488d-8f4e-aab1e8717887 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:43.947912 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c4d3-a5df-488d-8f4e-aab1e8717887 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:43.948371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c4d3-a5df-488d-8f4e-aab1e8717887 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:43.950129 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 213/420] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:40:43.958680 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd5244-2cdc-40c0-9f5e-de0a2226c7d7 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:43.959491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd5244-2cdc-40c0-9f5e-de0a2226c7d7 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:43.960252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd5244-2cdc-40c0-9f5e-de0a2226c7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:43.999721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba5595-7bcb-452b-a2a7-39585f1ec4f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:44.000466 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-d0fd5244-2cdc-40c0-9f5e-de0a2226c7d7 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:44.001299 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba5595-7bcb-452b-a2a7-39585f1ec4f4 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:44.002883 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-d0fd5244-2cdc-40c0-9f5e-de0a2226c7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:44.012630 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:44.127508 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 208/421] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:44.133458 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba5595-7bcb-452b-a2a7-39585f1ec4f4 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:44.243340 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 214/422] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:44.248033 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba5595-7bcb-452b-a2a7-39585f1ec4f4 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:44.252484 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:44.268538 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd5244-2cdc-40c0-9f5e-de0a2226c7d7 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:44.285724 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0da2a-32a8-43ad-af33-e6a5c42b76b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:44.286597 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0da2a-32a8-43ad-af33-e6a5c42b76b1 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:44.286881 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0da2a-32a8-43ad-af33-e6a5c42b76b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:44.287155 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0da2a-32a8-43ad-af33-e6a5c42b76b1 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:44.288497 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0da2a-32a8-43ad-af33-e6a5c42b76b1 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:44.289962 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0da2a-32a8-43ad-af33-e6a5c42b76b1 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:44.296643 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 209/423] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:44 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:44.297387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0da2a-32a8-43ad-af33-e6a5c42b76b1 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:44.320508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:44.418245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd5244-2cdc-40c0-9f5e-de0a2226c7d7 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:44.432948 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0da2a-32a8-43ad-af33-e6a5c42b76b1 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:44.475456 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0ad78-4360-4cfa-bfd0-9273c705b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:44.476392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0ad78-4360-4cfa-bfd0-9273c705b641 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:44.476934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0ad78-4360-4cfa-bfd0-9273c705b641 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:44.477211 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0ad78-4360-4cfa-bfd0-9273c705b641 None admin] PATH_INFO: `/v3/groups/72719c57e37a4eba89ab83e908f4f61c` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:44.478466 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0ad78-4360-4cfa-bfd0-9273c705b641 None admin] RBAC: Authorizing `identity:get_group(group_id=72719c57e37a4eba89ab83e908f4f61c)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:44.480189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0ad78-4360-4cfa-bfd0-9273c705b641 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:44.483443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 210/424] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:44 2022] GET /identity/v3/groups/72719c57e37a4eba89ab83e908f4f61c => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:44.489908 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0ad78-4360-4cfa-bfd0-9273c705b641 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:44.532638 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:44.573980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352dd22-5f23-4f34-bcc2-e2af70483319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:44.574871 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352dd22-5f23-4f34-bcc2-e2af70483319 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:44.575198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352dd22-5f23-4f34-bcc2-e2af70483319 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:44.575621 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352dd22-5f23-4f34-bcc2-e2af70483319 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:44.604740 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352dd22-5f23-4f34-bcc2-e2af70483319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-8352dd22-5f23-4f34-bcc2-e2af70483319 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:44.625352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:44.626337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:44.627128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:44.627128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:44.627128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:44.627128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:44.627128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:44.627128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:44.627128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:44.627128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:44.627128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:44.627128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:44.627128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:44.627128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:44.631727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 215/425] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:40:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:44.636286 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352dd22-5f23-4f34-bcc2-e2af70483319 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:44.654262 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0ad78-4360-4cfa-bfd0-9273c705b641 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:44.729424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32d82f-1ddd-404a-ac07-97a0a414f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:44.730103 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32d82f-1ddd-404a-ac07-97a0a414f171 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:44.730412 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32d82f-1ddd-404a-ac07-97a0a414f171 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:44.730659 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32d82f-1ddd-404a-ac07-97a0a414f171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:44.732032 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32d82f-1ddd-404a-ac07-97a0a414f171 None admin] RBAC: Adding query filter params (group.id=72719c57e37a4eba89ab83e908f4f61c, role.id=4a110f9a625548a990ed70fad43f73b0, scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:44.732393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32d82f-1ddd-404a-ac07-97a0a414f171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:44.734216 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32d82f-1ddd-404a-ac07-97a0a414f171 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:44.759981 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 211/426] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 13:40:44 2022] GET /identity/v3/role_assignments?group.id=72719c57e37a4eba89ab83e908f4f61c&scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0&role.id=4a110f9a625548a990ed70fad43f73b0 => generated 611 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:44.820781 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352dd22-5f23-4f34-bcc2-e2af70483319 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:44.824512 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:44.879024 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021e6e6-83d4-4a73-8f76-8803816ddae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:44.879997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021e6e6-83d4-4a73-8f76-8803816ddae0 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:44.880469 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021e6e6-83d4-4a73-8f76-8803816ddae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:44.880917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021e6e6-83d4-4a73-8f76-8803816ddae0 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:44.881834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021e6e6-83d4-4a73-8f76-8803816ddae0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:44.882308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021e6e6-83d4-4a73-8f76-8803816ddae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:44.883869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021e6e6-83d4-4a73-8f76-8803816ddae0 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:44.893883 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 216/427] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:44.899635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32d82f-1ddd-404a-ac07-97a0a414f171 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:45.067151 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:45.081764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32d82f-1ddd-404a-ac07-97a0a414f171 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:45.132293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa723d12-d035-4130-a1a6-b2e274aa1dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:45.132956 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa723d12-d035-4130-a1a6-b2e274aa1dc8 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:45.133240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa723d12-d035-4130-a1a6-b2e274aa1dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:45.133586 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa723d12-d035-4130-a1a6-b2e274aa1dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:45.138074 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caad7b-70a4-41a2-b27b-22ed24159702 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:45.138074 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caad7b-70a4-41a2-b27b-22ed24159702 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:45.138074 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caad7b-70a4-41a2-b27b-22ed24159702 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:45.140691 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 217/428] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:45.145123 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa5146-305c-438f-a9b7-f03b3fdb7de2 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:45.145420 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa5146-305c-438f-a9b7-f03b3fdb7de2 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:45.145706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa5146-305c-438f-a9b7-f03b3fdb7de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:45.170289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-88fa5146-305c-438f-a9b7-f03b3fdb7de2 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:45.172553 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-88fa5146-305c-438f-a9b7-f03b3fdb7de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:45.230073 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa723d12-d035-4130-a1a6-b2e274aa1dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:45.232101 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa723d12-d035-4130-a1a6-b2e274aa1dc8 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:45.270360 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 218/429] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:45.310176 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa5146-305c-438f-a9b7-f03b3fdb7de2 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:45.345495 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:45.363067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 212/430] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:45.368496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa723d12-d035-4130-a1a6-b2e274aa1dc8 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:45.432918 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa5146-305c-438f-a9b7-f03b3fdb7de2 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:45.434931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:45.487840 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a3260-ba91-4647-81a7-63f4b8f0c053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:45.488990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a3260-ba91-4647-81a7-63f4b8f0c053 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:45.489427 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a3260-ba91-4647-81a7-63f4b8f0c053 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:45.489850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a3260-ba91-4647-81a7-63f4b8f0c053 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:45.505876 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a3260-ba91-4647-81a7-63f4b8f0c053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-d82a3260-ba91-4647-81a7-63f4b8f0c053 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:45.518088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:45.519053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:45.519861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:45.519861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:45.519861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:45.519861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:45.519861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:45.519861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:45.519861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:45.519861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:45.519861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:45.519861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:45.519861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:40:45.519861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:45.527334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 219/431] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:45.529059 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a3260-ba91-4647-81a7-63f4b8f0c053 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:45.530777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa723d12-d035-4130-a1a6-b2e274aa1dc8 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:45.578920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b87c3-3cf0-4ed7-9570-7749189003a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:45.579842 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b87c3-3cf0-4ed7-9570-7749189003a1 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:45.580131 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b87c3-3cf0-4ed7-9570-7749189003a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:45.580422 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b87c3-3cf0-4ed7-9570-7749189003a1 None admin] PATH_INFO: `/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:45.581630 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b87c3-3cf0-4ed7-9570-7749189003a1 None admin] RBAC: Authorizing `identity:get_project(project_id=c0baa23d9f8e4a49ad2b6910b32414a0)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:45.583150 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b87c3-3cf0-4ed7-9570-7749189003a1 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:45.585229 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 213/432] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:45 2022] GET /identity/v3/projects/c0baa23d9f8e4a49ad2b6910b32414a0 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:45.590296 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b87c3-3cf0-4ed7-9570-7749189003a1 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:45.646716 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a3260-ba91-4647-81a7-63f4b8f0c053 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:45.666094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:45.686394 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd4c87-7d5f-4cfd-b4db-13c2ab9e7a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:45.687472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd4c87-7d5f-4cfd-b4db-13c2ab9e7a81 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:45.687964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd4c87-7d5f-4cfd-b4db-13c2ab9e7a81 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:45.688485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd4c87-7d5f-4cfd-b4db-13c2ab9e7a81 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:45.689457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd4c87-7d5f-4cfd-b4db-13c2ab9e7a81 None admin] RBAC: Adding query filter params (name=member) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:45.689998 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd4c87-7d5f-4cfd-b4db-13c2ab9e7a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:45.691624 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd4c87-7d5f-4cfd-b4db-13c2ab9e7a81 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:45.701755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 220/433] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:40:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:45.708466 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd4c87-7d5f-4cfd-b4db-13c2ab9e7a81 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:45.724035 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b87c3-3cf0-4ed7-9570-7749189003a1 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:45.730468 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:45.769425 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a62a8-2e5c-4776-ac88-f59f16b75f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:45.770314 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a62a8-2e5c-4776-ac88-f59f16b75f9b None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:45.770600 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a62a8-2e5c-4776-ac88-f59f16b75f9b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:45.770977 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a62a8-2e5c-4776-ac88-f59f16b75f9b None admin] PATH_INFO: `/v3/groups/72719c57e37a4eba89ab83e908f4f61c` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:45.772910 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a62a8-2e5c-4776-ac88-f59f16b75f9b None admin] RBAC: Authorizing `identity:get_group(group_id=72719c57e37a4eba89ab83e908f4f61c)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:45.774373 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a62a8-2e5c-4776-ac88-f59f16b75f9b None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:45.776368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 214/434] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:45 2022] GET /identity/v3/groups/72719c57e37a4eba89ab83e908f4f61c => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:45.782393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a62a8-2e5c-4776-ac88-f59f16b75f9b None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:45.837117 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd4c87-7d5f-4cfd-b4db-13c2ab9e7a81 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:45.889383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315df2-35b1-4e70-886b-3eebdf651f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:45.891239 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315df2-35b1-4e70-886b-3eebdf651f1e None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:45.892315 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315df2-35b1-4e70-886b-3eebdf651f1e None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:45.892934 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315df2-35b1-4e70-886b-3eebdf651f1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:45.928029 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a62a8-2e5c-4776-ac88-f59f16b75f9b None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:45.956787 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:45.966643 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f30b68-6275-4603-b4f0-e2a5e9dd64be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:45.967511 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f30b68-6275-4603-b4f0-e2a5e9dd64be None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:45.967870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f30b68-6275-4603-b4f0-e2a5e9dd64be None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:45.968280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f30b68-6275-4603-b4f0-e2a5e9dd64be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:45.969200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f30b68-6275-4603-b4f0-e2a5e9dd64be None admin] RBAC: Adding query filter params (group.id=72719c57e37a4eba89ab83e908f4f61c, role.id=97e1bde6953846e0b3e2204a9aa8868d, scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:45.969594 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f30b68-6275-4603-b4f0-e2a5e9dd64be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:45.971210 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f30b68-6275-4603-b4f0-e2a5e9dd64be None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:45.978137 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 215/435] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 13:40:45 2022] GET /identity/v3/role_assignments?group.id=72719c57e37a4eba89ab83e908f4f61c&scope.project.id=c0baa23d9f8e4a49ad2b6910b32414a0&role.id=97e1bde6953846e0b3e2204a9aa8868d => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:45.999661 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89315df2-35b1-4e70-886b-3eebdf651f1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:46.001535 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89315df2-35b1-4e70-886b-3eebdf651f1e None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:46.024480 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:46.130854 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 221/436] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:40:46.132367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f30b68-6275-4603-b4f0-e2a5e9dd64be None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:46.259056 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f30b68-6275-4603-b4f0-e2a5e9dd64be None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:46.297123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bb982-e38c-44f3-9634-706435b51edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:46.298009 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bb982-e38c-44f3-9634-706435b51edd None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:46.298295 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bb982-e38c-44f3-9634-706435b51edd None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:46.298573 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bb982-e38c-44f3-9634-706435b51edd None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:46.299812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bb982-e38c-44f3-9634-706435b51edd None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:46.301317 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bb982-e38c-44f3-9634-706435b51edd None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:46.307653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 216/437] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:46 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:46.309105 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315df2-35b1-4e70-886b-3eebdf651f1e None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:46.359485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9333-1419-41db-ba54-1bcf3d242ea2 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:46.359992 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9333-1419-41db-ba54-1bcf3d242ea2 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:46.360066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9333-1419-41db-ba54-1bcf3d242ea2 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:46.361963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 217/438] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:46.368218 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58f018-4e00-4a43-bd2d-c0bbd3215fda None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:46.368468 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58f018-4e00-4a43-bd2d-c0bbd3215fda None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:46.368681 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58f018-4e00-4a43-bd2d-c0bbd3215fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:46.391017 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-ad58f018-4e00-4a43-bd2d-c0bbd3215fda None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:46.392876 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-ad58f018-4e00-4a43-bd2d-c0bbd3215fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:46.439574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315df2-35b1-4e70-886b-3eebdf651f1e None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:46.463727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:46.473732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:46.490011 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 218/439] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:46.493026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765be869-f608-4072-bf7f-ec23684b7c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:46.493237 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765be869-f608-4072-bf7f-ec23684b7c7f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:46.493502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765be869-f608-4072-bf7f-ec23684b7c7f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:46.493830 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765be869-f608-4072-bf7f-ec23684b7c7f None admin] PATH_INFO: `/v3/groups/72719c57e37a4eba89ab83e908f4f61c` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:46.495032 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765be869-f608-4072-bf7f-ec23684b7c7f None admin] RBAC: Authorizing `identity:get_group(group_id=72719c57e37a4eba89ab83e908f4f61c)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:46.497070 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765be869-f608-4072-bf7f-ec23684b7c7f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:46.498416 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 222/440] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:46 2022] GET /identity/v3/groups/72719c57e37a4eba89ab83e908f4f61c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:46.508146 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58f018-4e00-4a43-bd2d-c0bbd3215fda None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:46.515796 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765be869-f608-4072-bf7f-ec23684b7c7f None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:46.615137 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58f018-4e00-4a43-bd2d-c0bbd3215fda None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:46.631750 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765be869-f608-4072-bf7f-ec23684b7c7f None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:46.652509 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83e970-be71-489a-8f04-7991bda5d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:46.654666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83e970-be71-489a-8f04-7991bda5d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:46.655009 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83e970-be71-489a-8f04-7991bda5d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:46.655287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83e970-be71-489a-8f04-7991bda5d6f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:46.656157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83e970-be71-489a-8f04-7991bda5d6f1 None admin] RBAC: Adding query filter params (group.id=72719c57e37a4eba89ab83e908f4f61c, role.id=4a110f9a625548a990ed70fad43f73b0, scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:46.656476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83e970-be71-489a-8f04-7991bda5d6f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:46.658001 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83e970-be71-489a-8f04-7991bda5d6f1 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:46.667991 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 219/441] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 13:40:46 2022] GET /identity/v3/role_assignments?group.id=72719c57e37a4eba89ab83e908f4f61c&scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc&role.id=4a110f9a625548a990ed70fad43f73b0 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:46.667991 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a40b22-bec4-4cc5-af23-4f19e7b51714 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:46.667991 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a40b22-bec4-4cc5-af23-4f19e7b51714 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:46.667991 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a40b22-bec4-4cc5-af23-4f19e7b51714 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:46.667991 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 220/442] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:46.673874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f096de-c72c-40d1-8763-9ee7abf9f4de None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:46.674165 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f096de-c72c-40d1-8763-9ee7abf9f4de None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:46.674446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f096de-c72c-40d1-8763-9ee7abf9f4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:46.679395 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbeac4d-c65f-4922-a972-ab6256d0562d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:46.680386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbeac4d-c65f-4922-a972-ab6256d0562d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:46.680672 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbeac4d-c65f-4922-a972-ab6256d0562d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:46.680984 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbeac4d-c65f-4922-a972-ab6256d0562d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:46.693222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-68f096de-c72c-40d1-8763-9ee7abf9f4de None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:46.694402 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbeac4d-c65f-4922-a972-ab6256d0562d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:46.694509 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-68f096de-c72c-40d1-8763-9ee7abf9f4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-7bbeac4d-c65f-4922-a972-ab6256d0562d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:46.704533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:46.705531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:46.706726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:46.706726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:46.706726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:46.706726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:46.706726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:46.706726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:46.706726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:46.706726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:46.706726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:46.706726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:46.706726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:46.706726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:46.710094 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 223/443] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:40:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:46.710921 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbeac4d-c65f-4922-a972-ab6256d0562d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:46.752467 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:46.766442 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:46.777865 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 221/444] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:46.801551 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f096de-c72c-40d1-8763-9ee7abf9f4de None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:46.832563 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbeac4d-c65f-4922-a972-ab6256d0562d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:46.871697 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9952433-2b2f-4a7c-9d26-cba812da7af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:46.872862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9952433-2b2f-4a7c-9d26-cba812da7af2 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:46.872862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9952433-2b2f-4a7c-9d26-cba812da7af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:46.873082 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9952433-2b2f-4a7c-9d26-cba812da7af2 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:46.874067 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9952433-2b2f-4a7c-9d26-cba812da7af2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:46.874247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9952433-2b2f-4a7c-9d26-cba812da7af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:46.875765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9952433-2b2f-4a7c-9d26-cba812da7af2 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:46.887254 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 224/445] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:46.894331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9952433-2b2f-4a7c-9d26-cba812da7af2 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:46.933505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f096de-c72c-40d1-8763-9ee7abf9f4de None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:46.992434 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186d95e-e7c0-4aca-8b4f-281625267350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:46.993264 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186d95e-e7c0-4aca-8b4f-281625267350 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:46.993540 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186d95e-e7c0-4aca-8b4f-281625267350 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:46.993804 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186d95e-e7c0-4aca-8b4f-281625267350 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:47.008464 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186d95e-e7c0-4aca-8b4f-281625267350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-2186d95e-e7c0-4aca-8b4f-281625267350 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:47.017097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:47.018066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:47.018851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 222/446] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:40:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:47.022849 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9952433-2b2f-4a7c-9d26-cba812da7af2 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:47.024268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186d95e-e7c0-4aca-8b4f-281625267350 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:47.031153 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:47.069570 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733391d-2ac4-451a-9008-e67188c4506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:47.070617 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733391d-2ac4-451a-9008-e67188c4506a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:47.071099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733391d-2ac4-451a-9008-e67188c4506a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:47.071384 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733391d-2ac4-451a-9008-e67188c4506a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:47.077112 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:47.135407 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186d95e-e7c0-4aca-8b4f-281625267350 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:47.143365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733391d-2ac4-451a-9008-e67188c4506a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:47.144892 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733391d-2ac4-451a-9008-e67188c4506a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:47.170198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996c137-b753-4cba-b8fc-787a6735006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:47.170882 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996c137-b753-4cba-b8fc-787a6735006e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:47.171170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996c137-b753-4cba-b8fc-787a6735006e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:47.171451 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996c137-b753-4cba-b8fc-787a6735006e None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:47.172248 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996c137-b753-4cba-b8fc-787a6735006e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:47.172560 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996c137-b753-4cba-b8fc-787a6735006e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:47.173938 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996c137-b753-4cba-b8fc-787a6735006e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:47.182078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 223/447] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:47.187777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996c137-b753-4cba-b8fc-787a6735006e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:47.246201 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 225/448] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:40:47.252086 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733391d-2ac4-451a-9008-e67188c4506a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:47.259846 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:47.289957 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996c137-b753-4cba-b8fc-787a6735006e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:47.292639 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:47.324510 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e3ddd-e418-4d5c-ac4c-739ccd7151f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:47.325199 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e3ddd-e418-4d5c-ac4c-739ccd7151f9 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:47.325484 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e3ddd-e418-4d5c-ac4c-739ccd7151f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:47.325762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e3ddd-e418-4d5c-ac4c-739ccd7151f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:47.353364 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733391d-2ac4-451a-9008-e67188c4506a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:47.389453 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61af77-dcfc-479e-94a0-91105baa30c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:47.390338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61af77-dcfc-479e-94a0-91105baa30c4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:47.390619 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61af77-dcfc-479e-94a0-91105baa30c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:47.390902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61af77-dcfc-479e-94a0-91105baa30c4 None admin] PATH_INFO: `/v3/projects/909371a65bb348a1b58a2f6624e12486` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:47.392088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61af77-dcfc-479e-94a0-91105baa30c4 None admin] RBAC: Authorizing `identity:get_project(project_id=909371a65bb348a1b58a2f6624e12486)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:47.393151 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e3ddd-e418-4d5c-ac4c-739ccd7151f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:47.393645 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61af77-dcfc-479e-94a0-91105baa30c4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:47.394647 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e3ddd-e418-4d5c-ac4c-739ccd7151f9 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:47.395252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 226/449] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:47 2022] GET /identity/v3/projects/909371a65bb348a1b58a2f6624e12486 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:47.400807 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61af77-dcfc-479e-94a0-91105baa30c4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:47.480385 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:47.504020 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 224/450] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:40:47.509510 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e3ddd-e418-4d5c-ac4c-739ccd7151f9 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:47.510854 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61af77-dcfc-479e-94a0-91105baa30c4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:47.512325 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:47.546770 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0653ba9-625a-4b1c-92af-b9ce7dd02f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:47.547539 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0653ba9-625a-4b1c-92af-b9ce7dd02f14 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:47.547817 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0653ba9-625a-4b1c-92af-b9ce7dd02f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:47.548086 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0653ba9-625a-4b1c-92af-b9ce7dd02f14 None admin] PATH_INFO: `/v3/groups/2cec0c78435d443b94ef03f75ef4a6e1` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:47.549310 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0653ba9-625a-4b1c-92af-b9ce7dd02f14 None admin] RBAC: Authorizing `identity:get_group(group_id=2cec0c78435d443b94ef03f75ef4a6e1)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:47.550760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0653ba9-625a-4b1c-92af-b9ce7dd02f14 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:47.552413 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 227/451] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:47 2022] GET /identity/v3/groups/2cec0c78435d443b94ef03f75ef4a6e1 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:47.558215 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0653ba9-625a-4b1c-92af-b9ce7dd02f14 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:47.609698 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e3ddd-e418-4d5c-ac4c-739ccd7151f9 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:47.646655 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f4dbc-d01f-41fd-aa68-ed7af6cd4a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:47.647517 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f4dbc-d01f-41fd-aa68-ed7af6cd4a9e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:47.647801 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f4dbc-d01f-41fd-aa68-ed7af6cd4a9e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:47.648070 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f4dbc-d01f-41fd-aa68-ed7af6cd4a9e None admin] PATH_INFO: `/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:47.649289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f4dbc-d01f-41fd-aa68-ed7af6cd4a9e None admin] RBAC: Authorizing `identity:get_project(project_id=6ad01a9f12cd4be89048efd0d4cd70cc)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:47.650734 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f4dbc-d01f-41fd-aa68-ed7af6cd4a9e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:47.652449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 225/452] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:40:47 2022] GET /identity/v3/projects/6ad01a9f12cd4be89048efd0d4cd70cc => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:47.658034 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f4dbc-d01f-41fd-aa68-ed7af6cd4a9e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:47.661061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0653ba9-625a-4b1c-92af-b9ce7dd02f14 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:47.695715 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1255d29-b970-4979-aeb8-4e1077815310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:47.696438 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1255d29-b970-4979-aeb8-4e1077815310 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:47.696665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1255d29-b970-4979-aeb8-4e1077815310 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:47.696938 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1255d29-b970-4979-aeb8-4e1077815310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:47.697774 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1255d29-b970-4979-aeb8-4e1077815310 None admin] RBAC: Adding query filter params (group.id=2cec0c78435d443b94ef03f75ef4a6e1, role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=909371a65bb348a1b58a2f6624e12486) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:47.698085 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1255d29-b970-4979-aeb8-4e1077815310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:47.699534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1255d29-b970-4979-aeb8-4e1077815310 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:47.708339 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 228/453] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 13:40:47 2022] GET /identity/v3/role_assignments?group.id=2cec0c78435d443b94ef03f75ef4a6e1&scope.project.id=909371a65bb348a1b58a2f6624e12486&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:47.734828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:47.769217 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f4dbc-d01f-41fd-aa68-ed7af6cd4a9e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:47.810043 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d2891-3201-479a-ae0f-a82bd7844db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:47.810858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d2891-3201-479a-ae0f-a82bd7844db7 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:47.811140 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d2891-3201-479a-ae0f-a82bd7844db7 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:47.811414 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d2891-3201-479a-ae0f-a82bd7844db7 None admin] PATH_INFO: `/v3/groups/72719c57e37a4eba89ab83e908f4f61c` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:47.812782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d2891-3201-479a-ae0f-a82bd7844db7 None admin] RBAC: Authorizing `identity:get_group(group_id=72719c57e37a4eba89ab83e908f4f61c)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:47.814334 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d2891-3201-479a-ae0f-a82bd7844db7 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:47.816434 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 226/454] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 13:40:47 2022] GET /identity/v3/groups/72719c57e37a4eba89ab83e908f4f61c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:47.822815 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1255d29-b970-4979-aeb8-4e1077815310 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:47.834950 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:47.937500 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1255d29-b970-4979-aeb8-4e1077815310 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:47.972194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c673fb-dea0-4ddb-8dc4-c4e86d1abd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:47.972867 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c673fb-dea0-4ddb-8dc4-c4e86d1abd02 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:47.973150 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c673fb-dea0-4ddb-8dc4-c4e86d1abd02 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:47.973425 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c673fb-dea0-4ddb-8dc4-c4e86d1abd02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:47.974280 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c673fb-dea0-4ddb-8dc4-c4e86d1abd02 None admin] RBAC: Adding query filter params (group.id=72719c57e37a4eba89ab83e908f4f61c, role.id=97e1bde6953846e0b3e2204a9aa8868d, scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:47.974594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c673fb-dea0-4ddb-8dc4-c4e86d1abd02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:47.976089 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c673fb-dea0-4ddb-8dc4-c4e86d1abd02 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:47.984517 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 229/455] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 13:40:47 2022] GET /identity/v3/role_assignments?group.id=72719c57e37a4eba89ab83e908f4f61c&scope.project.id=6ad01a9f12cd4be89048efd0d4cd70cc&role.id=97e1bde6953846e0b3e2204a9aa8868d => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:50.923197 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266215a3-727f-4d1d-9874-a4d744e6caf9 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:50.923715 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266215a3-727f-4d1d-9874-a4d744e6caf9 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:50.923787 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266215a3-727f-4d1d-9874-a4d744e6caf9 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:50.925452 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 227/456] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:50.931038 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36307aad-5e7d-40f3-a487-31a139d2e3eb None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:50.931542 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36307aad-5e7d-40f3-a487-31a139d2e3eb None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:50.931616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36307aad-5e7d-40f3-a487-31a139d2e3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:50.952533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-36307aad-5e7d-40f3-a487-31a139d2e3eb None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:50.953744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-36307aad-5e7d-40f3-a487-31a139d2e3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:50.965085 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82ce99-9a0b-42e4-88b5-124a106ad6b5 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:50.966210 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82ce99-9a0b-42e4-88b5-124a106ad6b5 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:50.966685 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82ce99-9a0b-42e4-88b5-124a106ad6b5 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:50.968596 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 228/457] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:50.973615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfcc8a-51df-4aba-ad1e-d5be7f2c9e3b None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:50.974153 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfcc8a-51df-4aba-ad1e-d5be7f2c9e3b None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:50.974619 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfcc8a-51df-4aba-ad1e-d5be7f2c9e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:51.003644 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-84bfcc8a-51df-4aba-ad1e-d5be7f2c9e3b None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:51.004875 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-84bfcc8a-51df-4aba-ad1e-d5be7f2c9e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:51.058812 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:51.066348 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 230/458] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:51.095619 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36307aad-5e7d-40f3-a487-31a139d2e3eb None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:51.156001 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 229/459] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:40:51.185400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfcc8a-51df-4aba-ad1e-d5be7f2c9e3b None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:51.269149 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:51.294896 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36307aad-5e7d-40f3-a487-31a139d2e3eb None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:51.320740 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfcc8a-51df-4aba-ad1e-d5be7f2c9e3b None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:51.350025 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37874-d16b-4da0-9c29-5ed5c0387400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:51.351690 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37874-d16b-4da0-9c29-5ed5c0387400 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:51.352001 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37874-d16b-4da0-9c29-5ed5c0387400 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:51.352316 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37874-d16b-4da0-9c29-5ed5c0387400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:51.364082 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f743e-d1c1-49c9-a9a3-f77e768d1f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:51.365294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f743e-d1c1-49c9-a9a3-f77e768d1f44 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:51.365768 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f743e-d1c1-49c9-a9a3-f77e768d1f44 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:51.366190 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f743e-d1c1-49c9-a9a3-f77e768d1f44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:51.367777 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d37874-d16b-4da0-9c29-5ed5c0387400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:51.369561 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d37874-d16b-4da0-9c29-5ed5c0387400 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:51.378746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f743e-d1c1-49c9-a9a3-f77e768d1f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:51.380433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f743e-d1c1-49c9-a9a3-f77e768d1f44 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-55d37874-d16b-4da0-9c29-5ed5c0387400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:51.393834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:51.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:51.397018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:51.397018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:51.397018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:51.397018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:51.397018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 231/460] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:51.397018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158258d4-0398-46ce-9345-bf53e8281138 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:51.397018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158258d4-0398-46ce-9345-bf53e8281138 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:51.397888 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158258d4-0398-46ce-9345-bf53e8281138 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:51.404342 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 232/461] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-c13f743e-d1c1-49c9-a9a3-f77e768d1f44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:51.404544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:51.406366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:51.408430 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:51.408430 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:51.408430 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:51.408430 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:51.408921 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158258d4-0398-46ce-9345-bf53e8281138 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:51.412149 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 230/462] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:51.414788 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d26c13-3212-4b19-bf08-d71af86c1f42 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:51.415080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d26c13-3212-4b19-bf08-d71af86c1f42 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:51.415363 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d26c13-3212-4b19-bf08-d71af86c1f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:51.434126 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-79d26c13-3212-4b19-bf08-d71af86c1f42 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:51.435860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-79d26c13-3212-4b19-bf08-d71af86c1f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:51.479749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:51.528241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 231/463] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:51.528241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d26c13-3212-4b19-bf08-d71af86c1f42 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:51.565558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158258d4-0398-46ce-9345-bf53e8281138 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:51.597658 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:51.617430 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf7fbd-6ad5-4f8b-b330-b57e63b11cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:51.618629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf7fbd-6ad5-4f8b-b330-b57e63b11cc9 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:51.620087 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf7fbd-6ad5-4f8b-b330-b57e63b11cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:51.620540 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf7fbd-6ad5-4f8b-b330-b57e63b11cc9 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:51.621446 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf7fbd-6ad5-4f8b-b330-b57e63b11cc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:51.622471 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf7fbd-6ad5-4f8b-b330-b57e63b11cc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:51.624071 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf7fbd-6ad5-4f8b-b330-b57e63b11cc9 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:51.641625 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 233/464] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:51.642820 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf7fbd-6ad5-4f8b-b330-b57e63b11cc9 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:51.657787 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d26c13-3212-4b19-bf08-d71af86c1f42 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:51.696488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017ef37-6258-4f5b-afe6-db86605a6a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:51.697179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017ef37-6258-4f5b-afe6-db86605a6a2e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:51.697466 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017ef37-6258-4f5b-afe6-db86605a6a2e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:51.697751 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017ef37-6258-4f5b-afe6-db86605a6a2e None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:51.698533 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017ef37-6258-4f5b-afe6-db86605a6a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:51.698846 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017ef37-6258-4f5b-afe6-db86605a6a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:51.700499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017ef37-6258-4f5b-afe6-db86605a6a2e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:51.720180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 232/465] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:51.720568 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017ef37-6258-4f5b-afe6-db86605a6a2e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:51.778634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf7fbd-6ad5-4f8b-b330-b57e63b11cc9 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:51.795188 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:51.822564 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996a732-ed44-4f17-81bd-b7bf458a3879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:51.823376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996a732-ed44-4f17-81bd-b7bf458a3879 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:51.823660 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996a732-ed44-4f17-81bd-b7bf458a3879 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:51.823937 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996a732-ed44-4f17-81bd-b7bf458a3879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:51.835109 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996a732-ed44-4f17-81bd-b7bf458a3879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:51.836679 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996a732-ed44-4f17-81bd-b7bf458a3879 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:51.838650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017ef37-6258-4f5b-afe6-db86605a6a2e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:51.854003 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-0996a732-ed44-4f17-81bd-b7bf458a3879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:51.857264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:51.858263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:51.859183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:51.859183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:51.859183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:51.859183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:51.859980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 234/466] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:51.865830 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680517e-319a-497c-b1c1-ec4297370768 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:51.866442 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680517e-319a-497c-b1c1-ec4297370768 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:51.866723 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680517e-319a-497c-b1c1-ec4297370768 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:51.868400 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 235/467] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:51.873388 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680517e-319a-497c-b1c1-ec4297370768 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:51.887156 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fe88c-5fa4-4f63-9061-116058e5a654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:51.888207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fe88c-5fa4-4f63-9061-116058e5a654 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:51.888582 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fe88c-5fa4-4f63-9061-116058e5a654 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:51.888866 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fe88c-5fa4-4f63-9061-116058e5a654 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:51.889729 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fe88c-5fa4-4f63-9061-116058e5a654 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:51.891355 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fe88c-5fa4-4f63-9061-116058e5a654 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:51.915783 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 233/468] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:40:51 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:40:51.929229 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fe88c-5fa4-4f63-9061-116058e5a654 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:52.000889 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680517e-319a-497c-b1c1-ec4297370768 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:52.045244 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e11d1-2f93-40e8-9183-d447f20d83e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:52.045861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e11d1-2f93-40e8-9183-d447f20d83e9 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:52.046077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e11d1-2f93-40e8-9183-d447f20d83e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:52.046358 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e11d1-2f93-40e8-9183-d447f20d83e9 None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:52.047103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e11d1-2f93-40e8-9183-d447f20d83e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:52.048688 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e11d1-2f93-40e8-9183-d447f20d83e9 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:52.070776 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fe88c-5fa4-4f63-9061-116058e5a654 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:52.076896 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 236/469] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:40:51 2022] POST /identity/v3/users => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:40:52.082125 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33f02a-639f-4c68-822f-47b85c3379b8 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:52.082865 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33f02a-639f-4c68-822f-47b85c3379b8 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:52.083372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33f02a-639f-4c68-822f-47b85c3379b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:52.122553 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-4e33f02a-639f-4c68-822f-47b85c3379b8 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:52.126045 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-4e33f02a-639f-4c68-822f-47b85c3379b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:52.146566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc31996-dfc3-4115-8cff-dcd2ab6099f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:52.147259 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc31996-dfc3-4115-8cff-dcd2ab6099f2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:52.147537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc31996-dfc3-4115-8cff-dcd2ab6099f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:52.147817 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc31996-dfc3-4115-8cff-dcd2ab6099f2 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:52.148706 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc31996-dfc3-4115-8cff-dcd2ab6099f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:52.149020 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc31996-dfc3-4115-8cff-dcd2ab6099f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:52.150446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc31996-dfc3-4115-8cff-dcd2ab6099f2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:52.152088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:52.169673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 234/470] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:52.176660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc31996-dfc3-4115-8cff-dcd2ab6099f2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:52.213665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:52.236473 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 237/471] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:52.266729 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33f02a-639f-4c68-822f-47b85c3379b8 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:52.329356 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc31996-dfc3-4115-8cff-dcd2ab6099f2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:52.373203 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006642af-3338-4e38-b752-bffe63c47f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:52.374274 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006642af-3338-4e38-b752-bffe63c47f4b None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:52.374559 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006642af-3338-4e38-b752-bffe63c47f4b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:52.374829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006642af-3338-4e38-b752-bffe63c47f4b None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:52.375854 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006642af-3338-4e38-b752-bffe63c47f4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:52.377329 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006642af-3338-4e38-b752-bffe63c47f4b None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:52.402150 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 235/472] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:40:52 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:40:52.404839 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238bfd3-2b98-47e9-972a-2f7cd91d4bb3 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:52.405055 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33f02a-639f-4c68-822f-47b85c3379b8 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:52.405160 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238bfd3-2b98-47e9-972a-2f7cd91d4bb3 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:52.405395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238bfd3-2b98-47e9-972a-2f7cd91d4bb3 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:52.407103 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 236/473] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:52.413126 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728e5e7-e448-47c7-ac9f-1635e28bb5d6 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:52.413546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728e5e7-e448-47c7-ac9f-1635e28bb5d6 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:52.413837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728e5e7-e448-47c7-ac9f-1635e28bb5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:52.434666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-c728e5e7-e448-47c7-ac9f-1635e28bb5d6 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:52.436018 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-c728e5e7-e448-47c7-ac9f-1635e28bb5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:52.466917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9878f4-ce15-49ea-8f97-b1c5d12a1107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:52.468216 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9878f4-ce15-49ea-8f97-b1c5d12a1107 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:52.468713 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9878f4-ce15-49ea-8f97-b1c5d12a1107 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:52.469216 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9878f4-ce15-49ea-8f97-b1c5d12a1107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:52.487829 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9878f4-ce15-49ea-8f97-b1c5d12a1107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:52.491756 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9878f4-ce15-49ea-8f97-b1c5d12a1107 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-cd9878f4-ce15-49ea-8f97-b1c5d12a1107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:52.515174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:52.516098 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:52.517032 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:52.517032 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:52.517032 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:52.517032 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:52.518289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 238/474] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:52.520285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 237/475] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:52.528278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9878f4-ce15-49ea-8f97-b1c5d12a1107 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:52.536602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:52.583410 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728e5e7-e448-47c7-ac9f-1635e28bb5d6 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:52.608553 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:52.696771 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9878f4-ce15-49ea-8f97-b1c5d12a1107 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:52.741079 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289a895-30d9-45ab-9d2c-71dbb1b08744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:52.741848 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289a895-30d9-45ab-9d2c-71dbb1b08744 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:52.742133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289a895-30d9-45ab-9d2c-71dbb1b08744 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:52.742407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289a895-30d9-45ab-9d2c-71dbb1b08744 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:52.743138 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289a895-30d9-45ab-9d2c-71dbb1b08744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:52.743443 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289a895-30d9-45ab-9d2c-71dbb1b08744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:52.746203 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289a895-30d9-45ab-9d2c-71dbb1b08744 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:52.755423 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728e5e7-e448-47c7-ac9f-1635e28bb5d6 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:52.761771 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 239/476] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:52.766985 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289a895-30d9-45ab-9d2c-71dbb1b08744 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:52.800343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d9cb6-4406-4207-a6e0-c27134acfa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:52.801290 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9cb6-4406-4207-a6e0-c27134acfa33 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:52.801719 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9cb6-4406-4207-a6e0-c27134acfa33 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:52.802179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9cb6-4406-4207-a6e0-c27134acfa33 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:52.803088 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d9cb6-4406-4207-a6e0-c27134acfa33 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:52.804649 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d9cb6-4406-4207-a6e0-c27134acfa33 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:52.813455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.sql.core [None req-af3d9cb6-4406-4207-a6e0-c27134acfa33 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 13:40:52.813455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 13:40:52.813455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [parameters: {'id': '5428a7e8d6b44565acaac8513da83afc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 13:40:52.813455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86643) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-af3d9cb6-4406-4207-a6e0-c27134acfa33 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application conn.query(q) May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application result.read() May 25 13:40:52.833798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return ref.to_dict() May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:40:52.834712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application next(self.gen) May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application yield resource May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application next(self.gen) May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self.session.rollback() May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self.force_reraise() May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise self.value May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application session.commit() May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 13:40:52.835667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._prepare_impl() May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self.session.flush() May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._flush(objects) May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application compat.raise_( May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application flush_context.execute() May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rec.execute(self) May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 13:40:52.836555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:40:52.837431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application conn.query(q) May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application result.read() May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:40:52.838241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [parameters: {'id': '5428a7e8d6b44565acaac8513da83afc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:52.839019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 13:40:52.839827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:52.844946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:52.845158 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 238/477] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 13:40:52 2022] POST /identity/v3/roles => generated 144 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:52.854039 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d9cb6-4406-4207-a6e0-c27134acfa33 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:52.911295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289a895-30d9-45ab-9d2c-71dbb1b08744 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:52.962250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d66af9-2eda-4689-a8fb-b1576804e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:52.963374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d66af9-2eda-4689-a8fb-b1576804e865 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:52.964489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d66af9-2eda-4689-a8fb-b1576804e865 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:52.964782 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d66af9-2eda-4689-a8fb-b1576804e865 None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:52.965688 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d66af9-2eda-4689-a8fb-b1576804e865 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:52.967248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d66af9-2eda-4689-a8fb-b1576804e865 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:52.978788 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:53.002698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 240/478] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:40:52 2022] POST /identity/v3/users => generated 249 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:40:53.012296 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d9cb6-4406-4207-a6e0-c27134acfa33 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:53.054284 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bb868-040a-4bd3-874c-81ee43ad8393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:53.055383 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bb868-040a-4bd3-874c-81ee43ad8393 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:53.055814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bb868-040a-4bd3-874c-81ee43ad8393 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:53.056301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bb868-040a-4bd3-874c-81ee43ad8393 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:53.078956 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bb868-040a-4bd3-874c-81ee43ad8393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-ca7bb868-040a-4bd3-874c-81ee43ad8393 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:53.089324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:53.090443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:53.091838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:53.091838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:53.091838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:53.091838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:53.091838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:53.091838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:53.091838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:53.091838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:53.091838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:53.091838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:53.091838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:40:53.091838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:53.094351 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 239/479] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:40:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:53.100424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d66af9-2eda-4689-a8fb-b1576804e865 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:53.227759 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d66af9-2eda-4689-a8fb-b1576804e865 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:53.252434 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:53.281256 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c18b2b-83d2-48d6-a750-e95874965150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:53.281951 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c18b2b-83d2-48d6-a750-e95874965150 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:53.282237 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c18b2b-83d2-48d6-a750-e95874965150 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:53.282516 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c18b2b-83d2-48d6-a750-e95874965150 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:53.283300 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c18b2b-83d2-48d6-a750-e95874965150 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:53.283613 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c18b2b-83d2-48d6-a750-e95874965150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:53.285094 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c18b2b-83d2-48d6-a750-e95874965150 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:53.297180 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 241/480] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:54.758301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3c8c2-601a-40b2-bafb-f3ca7d96ab59 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:54.758827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3c8c2-601a-40b2-bafb-f3ca7d96ab59 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:54.758827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3c8c2-601a-40b2-bafb-f3ca7d96ab59 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:54.760740 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 240/481] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:54.767554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a3a24-0ae9-486f-93f9-ef8636e43e1e None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:54.768071 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a3a24-0ae9-486f-93f9-ef8636e43e1e None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:54.768179 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a3a24-0ae9-486f-93f9-ef8636e43e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:54.786871 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-452a3a24-0ae9-486f-93f9-ef8636e43e1e None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:54.788366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-452a3a24-0ae9-486f-93f9-ef8636e43e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:54.872231 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 242/482] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:54.892372 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3c8c2-601a-40b2-bafb-f3ca7d96ab59 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:54.943755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217bfb-7f09-4111-a3eb-49fb5d4ebf39 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:54.944075 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217bfb-7f09-4111-a3eb-49fb5d4ebf39 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:54.944339 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217bfb-7f09-4111-a3eb-49fb5d4ebf39 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:54.945837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 243/483] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:40:54.953564 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5e5be-ed02-4324-8e8a-ce3f3d2eceee None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:54.953853 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5e5be-ed02-4324-8e8a-ce3f3d2eceee None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:54.954134 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5e5be-ed02-4324-8e8a-ce3f3d2eceee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:54.985561 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-6cf5e5be-ed02-4324-8e8a-ce3f3d2eceee None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:54.986796 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-6cf5e5be-ed02-4324-8e8a-ce3f3d2eceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:55.037635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3c8c2-601a-40b2-bafb-f3ca7d96ab59 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:55.095517 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e808a23-e3f6-4588-bae8-5e416172556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:55.097785 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e808a23-e3f6-4588-bae8-5e416172556d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:55.099566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e808a23-e3f6-4588-bae8-5e416172556d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:55.100043 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e808a23-e3f6-4588-bae8-5e416172556d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:55.116453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:55.122905 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 244/484] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:55.129108 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e808a23-e3f6-4588-bae8-5e416172556d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-3e808a23-e3f6-4588-bae8-5e416172556d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:55.136770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:55.138280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:55.139077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:55.139077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:55.139077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:55.139077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:55.139077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:55.139077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:55.139077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:55.139077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:55.139077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:55.139077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:55.139077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:40:55.139077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:55.140350 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 241/485] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:40:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:55.144735 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5e5be-ed02-4324-8e8a-ce3f3d2eceee None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:55.172959 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e808a23-e3f6-4588-bae8-5e416172556d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:55.218474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:55.328347 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5e5be-ed02-4324-8e8a-ce3f3d2eceee None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:55.358567 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e808a23-e3f6-4588-bae8-5e416172556d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:55.394532 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb285b-67b0-4552-8f45-4acb5c125026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:55.394741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6078e5-33b6-4500-a4d8-e4b23fc6e983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:55.395348 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb285b-67b0-4552-8f45-4acb5c125026 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:55.395480 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6078e5-33b6-4500-a4d8-e4b23fc6e983 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:55.395651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6078e5-33b6-4500-a4d8-e4b23fc6e983 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:55.395744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb285b-67b0-4552-8f45-4acb5c125026 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:55.395899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6078e5-33b6-4500-a4d8-e4b23fc6e983 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:55.395989 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb285b-67b0-4552-8f45-4acb5c125026 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:55.396696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6078e5-33b6-4500-a4d8-e4b23fc6e983 None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:55.397005 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6078e5-33b6-4500-a4d8-e4b23fc6e983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:55.398432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6078e5-33b6-4500-a4d8-e4b23fc6e983 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:55.408370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb285b-67b0-4552-8f45-4acb5c125026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-1afb285b-67b0-4552-8f45-4acb5c125026 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:55.416687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:55.417832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:55.418943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:55.418943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:55.418943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:55.418943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:55.418943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:55.418943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:55.418943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:55.418943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:55.418943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:55.418943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:55.418943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:40:55.418943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:55.419562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 245/486] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:40:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:55.424306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 242/487] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:40:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:55.425158 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6078e5-33b6-4500-a4d8-e4b23fc6e983 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:55.426122 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb285b-67b0-4552-8f45-4acb5c125026 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:55.494991 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:55.571214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb285b-67b0-4552-8f45-4acb5c125026 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:55.573661 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6078e5-33b6-4500-a4d8-e4b23fc6e983 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:55.584585 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:55.612819 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80220e-5565-4461-a9e6-e131c9ce8785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:55.613546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80220e-5565-4461-a9e6-e131c9ce8785 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:55.613833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80220e-5565-4461-a9e6-e131c9ce8785 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:55.614109 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80220e-5565-4461-a9e6-e131c9ce8785 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:55.614900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80220e-5565-4461-a9e6-e131c9ce8785 None admin] RBAC: Adding query filter params (name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:55.615211 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80220e-5565-4461-a9e6-e131c9ce8785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:55.616438 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bc041-411f-4b5e-a7e3-6530c70bfeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:55.616646 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80220e-5565-4461-a9e6-e131c9ce8785 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:55.617369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bc041-411f-4b5e-a7e3-6530c70bfeec None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:55.617731 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bc041-411f-4b5e-a7e3-6530c70bfeec None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:55.618376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bc041-411f-4b5e-a7e3-6530c70bfeec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:55.627479 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 243/488] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:40:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:55.628949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8f924-ad04-4e0b-a84a-febe0f821469 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:55.629245 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8f924-ad04-4e0b-a84a-febe0f821469 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:55.629526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8f924-ad04-4e0b-a84a-febe0f821469 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:55.631106 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 244/489] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:55.632938 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8f924-ad04-4e0b-a84a-febe0f821469 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:55.641318 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bc041-411f-4b5e-a7e3-6530c70bfeec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:55.647062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bc041-411f-4b5e-a7e3-6530c70bfeec None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-1c3bc041-411f-4b5e-a7e3-6530c70bfeec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:55.675157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:55.676175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:55.677705 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:55.677705 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:55.677705 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:55.677705 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:55.677705 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 246/490] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:55.678319 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06f926-2997-4b3d-93ed-13c2286b4909 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:55.680325 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06f926-2997-4b3d-93ed-13c2286b4909 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:55.680325 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06f926-2997-4b3d-93ed-13c2286b4909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:55.701095 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-9f06f926-2997-4b3d-93ed-13c2286b4909 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:55.702341 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-9f06f926-2997-4b3d-93ed-13c2286b4909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:55.785346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8f924-ad04-4e0b-a84a-febe0f821469 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:55.800476 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 247/491] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:55.801969 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06f926-2997-4b3d-93ed-13c2286b4909 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:55.807222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:55.830508 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a9796-b414-464a-9af3-fe7879823550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:55.830508 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a9796-b414-464a-9af3-fe7879823550 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:55.830508 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a9796-b414-464a-9af3-fe7879823550 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:55.830508 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a9796-b414-464a-9af3-fe7879823550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:55.847059 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a9796-b414-464a-9af3-fe7879823550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:55.847059 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a9796-b414-464a-9af3-fe7879823550 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-605a9796-b414-464a-9af3-fe7879823550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:55.866420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:55.867368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:55.868280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:55.868280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:55.868280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:55.868280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:55.868280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 245/492] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:55.873143 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a9796-b414-464a-9af3-fe7879823550 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:55.933800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:55.953259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06f926-2997-4b3d-93ed-13c2286b4909 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:55.990443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a9796-b414-464a-9af3-fe7879823550 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:55.992650 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd01e6c-2c9d-496f-bac1-d27e3f16aff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:55.993580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd01e6c-2c9d-496f-bac1-d27e3f16aff0 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:55.994047 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd01e6c-2c9d-496f-bac1-d27e3f16aff0 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:55.994556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd01e6c-2c9d-496f-bac1-d27e3f16aff0 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:55.995556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd01e6c-2c9d-496f-bac1-d27e3f16aff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:55.996045 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd01e6c-2c9d-496f-bac1-d27e3f16aff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:55.998235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd01e6c-2c9d-496f-bac1-d27e3f16aff0 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:56.011920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 248/493] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:56.013273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd01e6c-2c9d-496f-bac1-d27e3f16aff0 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:56.038901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058bab1-599b-4aa3-80f4-01dcdbc92f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:56.039834 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058bab1-599b-4aa3-80f4-01dcdbc92f4d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.040261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058bab1-599b-4aa3-80f4-01dcdbc92f4d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.040605 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058bab1-599b-4aa3-80f4-01dcdbc92f4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.055147 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058bab1-599b-4aa3-80f4-01dcdbc92f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-4058bab1-599b-4aa3-80f4-01dcdbc92f4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:56.063735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:56.064858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 246/494] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:40:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:56.070877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058bab1-599b-4aa3-80f4-01dcdbc92f4d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:56.099763 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:56.134385 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd01e6c-2c9d-496f-bac1-d27e3f16aff0 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:56.171067 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cf28b-95f9-4a71-9adf-75e2adf7e601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:56.171743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cf28b-95f9-4a71-9adf-75e2adf7e601 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.172031 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cf28b-95f9-4a71-9adf-75e2adf7e601 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.172339 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cf28b-95f9-4a71-9adf-75e2adf7e601 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.173086 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cf28b-95f9-4a71-9adf-75e2adf7e601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:56.173463 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cf28b-95f9-4a71-9adf-75e2adf7e601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:56.174884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cf28b-95f9-4a71-9adf-75e2adf7e601 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:56.179793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058bab1-599b-4aa3-80f4-01dcdbc92f4d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:56.192454 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 249/495] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:56.193835 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dcb62-9b25-4092-8dc1-1dcc58916ddd None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.194126 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dcb62-9b25-4092-8dc1-1dcc58916ddd None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.194407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dcb62-9b25-4092-8dc1-1dcc58916ddd None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.197512 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 250/496] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:56.197512 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dcb62-9b25-4092-8dc1-1dcc58916ddd None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:56.204626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:56.235733 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e715-7a12-4cb2-88f2-6f54a9fc3aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:56.237033 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e715-7a12-4cb2-88f2-6f54a9fc3aaf None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.237324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e715-7a12-4cb2-88f2-6f54a9fc3aaf None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.237601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e715-7a12-4cb2-88f2-6f54a9fc3aaf None admin] PATH_INFO: `/v3/users/glance` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.249466 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9e715-7a12-4cb2-88f2-6f54a9fc3aaf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:56.250955 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9e715-7a12-4cb2-88f2-6f54a9fc3aaf None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-aad9e715-7a12-4cb2-88f2-6f54a9fc3aaf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:40:56.266852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:56.267759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:56.268825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:56.268825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:56.268825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:40:56.268825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:40:56.268825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:40:56.268825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:40:56.268825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:40:56.268825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:40:56.268825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 13:40:56.268825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:56.268825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 247/497] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:56.268825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e715-7a12-4cb2-88f2-6f54a9fc3aaf None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:56.315786 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dcb62-9b25-4092-8dc1-1dcc58916ddd None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:56.350441 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15f0b5-f414-4d4f-807e-3301c2233afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:56.351038 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f0b5-f414-4d4f-807e-3301c2233afb None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.351575 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f0b5-f414-4d4f-807e-3301c2233afb None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.351852 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f0b5-f414-4d4f-807e-3301c2233afb None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.352717 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15f0b5-f414-4d4f-807e-3301c2233afb None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:56.353033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15f0b5-f414-4d4f-807e-3301c2233afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:56.354429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15f0b5-f414-4d4f-807e-3301c2233afb None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:56.360549 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:56.362900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 251/498] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:40:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:56.364251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bde43-8f64-4010-ba32-a7d3d44d83fa None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.364548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bde43-8f64-4010-ba32-a7d3d44d83fa None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.364829 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bde43-8f64-4010-ba32-a7d3d44d83fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.370113 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e715-7a12-4cb2-88f2-6f54a9fc3aaf None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:56.381963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-c28bde43-8f64-4010-ba32-a7d3d44d83fa None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:56.383158 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-c28bde43-8f64-4010-ba32-a7d3d44d83fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:56.404764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc68a7b-9753-4a45-9a42-576151addfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:56.405566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68a7b-9753-4a45-9a42-576151addfc7 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.405851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68a7b-9753-4a45-9a42-576151addfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.406128 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68a7b-9753-4a45-9a42-576151addfc7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.413802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc68a7b-9753-4a45-9a42-576151addfc7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:56.415304 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc68a7b-9753-4a45-9a42-576151addfc7 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-6cc68a7b-9753-4a45-9a42-576151addfc7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:40:56.429770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:56.430923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:56.431826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:56.431826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:56.431826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:40:56.431826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:40:56.431826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:40:56.431826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:40:56.431826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:40:56.431826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:40:56.431826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:40:56.431826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:56.431826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 248/499] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 13:40:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:56.432509 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276fe80-723b-4245-856d-879fd3d15bdb None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.432797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276fe80-723b-4245-856d-879fd3d15bdb None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.433055 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276fe80-723b-4245-856d-879fd3d15bdb None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.434773 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 249/500] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:56.435475 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276fe80-723b-4245-856d-879fd3d15bdb None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:56.449912 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:56.460163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 252/501] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:56.461553 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bde43-8f64-4010-ba32-a7d3d44d83fa None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:56.556761 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276fe80-723b-4245-856d-879fd3d15bdb None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:56.572271 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bde43-8f64-4010-ba32-a7d3d44d83fa None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:56.589977 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc0f4a-6a2a-4ff3-8f7b-e92094169b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:56.590815 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc0f4a-6a2a-4ff3-8f7b-e92094169b46 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.591101 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc0f4a-6a2a-4ff3-8f7b-e92094169b46 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.591377 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc0f4a-6a2a-4ff3-8f7b-e92094169b46 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.592256 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc0f4a-6a2a-4ff3-8f7b-e92094169b46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:56.592568 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc0f4a-6a2a-4ff3-8f7b-e92094169b46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:56.594013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc0f4a-6a2a-4ff3-8f7b-e92094169b46 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:56.606209 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad6236-2379-4263-8098-30f935262b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:56.606944 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad6236-2379-4263-8098-30f935262b5f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.607236 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad6236-2379-4263-8098-30f935262b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.607515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad6236-2379-4263-8098-30f935262b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.619911 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad6236-2379-4263-8098-30f935262b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:56.621993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad6236-2379-4263-8098-30f935262b5f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:56.633724 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 250/502] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 13:40:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:56.634577 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc0f4a-6a2a-4ff3-8f7b-e92094169b46 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-bdad6236-2379-4263-8098-30f935262b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:56.640664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:56.641513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:56.643193 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:56.643193 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:56.643193 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:56.643193 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:56.643413 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 253/503] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:56.644573 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923124-6573-4969-bcaf-4747360cc37b None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.644868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923124-6573-4969-bcaf-4747360cc37b None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.645148 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923124-6573-4969-bcaf-4747360cc37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.649318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:56.663125 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-8f923124-6573-4969-bcaf-4747360cc37b None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:56.664399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-8f923124-6573-4969-bcaf-4747360cc37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:56.713871 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:56.741987 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 254/504] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:40:56.742882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923124-6573-4969-bcaf-4747360cc37b None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:56.753805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc0f4a-6a2a-4ff3-8f7b-e92094169b46 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:56.792821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1921d-4ccf-4255-b139-c4ccd8edfc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:56.794155 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1921d-4ccf-4255-b139-c4ccd8edfc72 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.794705 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1921d-4ccf-4255-b139-c4ccd8edfc72 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.794954 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1921d-4ccf-4255-b139-c4ccd8edfc72 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.795831 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1921d-4ccf-4255-b139-c4ccd8edfc72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:56.796155 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1921d-4ccf-4255-b139-c4ccd8edfc72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:56.797635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1921d-4ccf-4255-b139-c4ccd8edfc72 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:56.816828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 251/505] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 13:40:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:56.817702 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1921d-4ccf-4255-b139-c4ccd8edfc72 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:56.854763 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923124-6573-4969-bcaf-4747360cc37b None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:56.889354 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:56.891545 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a53d-3836-4c37-b8d0-35a8d97da2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:56.892388 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a53d-3836-4c37-b8d0-35a8d97da2f2 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.892683 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a53d-3836-4c37-b8d0-35a8d97da2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.892956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a53d-3836-4c37-b8d0-35a8d97da2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:56.905097 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672a53d-3836-4c37-b8d0-35a8d97da2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:56.906633 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672a53d-3836-4c37-b8d0-35a8d97da2f2 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-9672a53d-3836-4c37-b8d0-35a8d97da2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:56.925917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:56.927044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:56.928096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:56.928096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:56.928096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:56.928096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:56.928407 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1921d-4ccf-4255-b139-c4ccd8edfc72 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:56.928493 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 255/506] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:56.928493 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a53d-3836-4c37-b8d0-35a8d97da2f2 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:56.960530 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:56.966733 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544c95b-e0c5-42dd-ac20-e813d610e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:56.967404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544c95b-e0c5-42dd-ac20-e813d610e6c4 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:56.967742 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544c95b-e0c5-42dd-ac20-e813d610e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:56.968021 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544c95b-e0c5-42dd-ac20-e813d610e6c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:57.037424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544c95b-e0c5-42dd-ac20-e813d610e6c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:57.038899 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544c95b-e0c5-42dd-ac20-e813d610e6c4 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:57.045255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a53d-3836-4c37-b8d0-35a8d97da2f2 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:57.081601 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700aaea4-46bd-4b61-96a4-d7340b5b3e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:57.082269 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700aaea4-46bd-4b61-96a4-d7340b5b3e70 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:57.082556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700aaea4-46bd-4b61-96a4-d7340b5b3e70 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:57.082838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700aaea4-46bd-4b61-96a4-d7340b5b3e70 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:57.083567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700aaea4-46bd-4b61-96a4-d7340b5b3e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:57.083878 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700aaea4-46bd-4b61-96a4-d7340b5b3e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:57.085309 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700aaea4-46bd-4b61-96a4-d7340b5b3e70 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:57.097289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 256/507] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:57.098118 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700aaea4-46bd-4b61-96a4-d7340b5b3e70 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:57.113501 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:57.147977 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 252/508] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:57.148864 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544c95b-e0c5-42dd-ac20-e813d610e6c4 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:57.191071 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:57.202226 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700aaea4-46bd-4b61-96a4-d7340b5b3e70 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:57.235709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac146a-1318-44d7-87d2-5b4cba17c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:57.236543 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac146a-1318-44d7-87d2-5b4cba17c716 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:57.236828 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac146a-1318-44d7-87d2-5b4cba17c716 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:57.237100 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac146a-1318-44d7-87d2-5b4cba17c716 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:57.247926 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac146a-1318-44d7-87d2-5b4cba17c716 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:57.249601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544c95b-e0c5-42dd-ac20-e813d610e6c4 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-1eac146a-1318-44d7-87d2-5b4cba17c716 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:57.255768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:57.256899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:57.257920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 257/509] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:40:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:57.259986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac146a-1318-44d7-87d2-5b4cba17c716 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:57.285956 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fb397-3cda-48e8-9121-969448a0f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:57.286613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fb397-3cda-48e8-9121-969448a0f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:57.286894 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fb397-3cda-48e8-9121-969448a0f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:57.287170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fb397-3cda-48e8-9121-969448a0f1e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:57.323726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:57.359227 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fb397-3cda-48e8-9121-969448a0f1e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:57.360733 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fb397-3cda-48e8-9121-969448a0f1e4 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:57.366475 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac146a-1318-44d7-87d2-5b4cba17c716 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:57.400850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d3efe-c4f7-4d75-a52c-91edd872d539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:57.401458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d3efe-c4f7-4d75-a52c-91edd872d539 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:57.401773 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d3efe-c4f7-4d75-a52c-91edd872d539 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:57.402088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d3efe-c4f7-4d75-a52c-91edd872d539 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:57.403007 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d3efe-c4f7-4d75-a52c-91edd872d539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:57.403346 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d3efe-c4f7-4d75-a52c-91edd872d539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:57.404845 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d3efe-c4f7-4d75-a52c-91edd872d539 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:57.417478 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 258/510] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:57.418988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d3efe-c4f7-4d75-a52c-91edd872d539 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:57.432668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:57.459838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 253/511] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:57.460722 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fb397-3cda-48e8-9121-969448a0f1e4 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:57.526985 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d3efe-c4f7-4d75-a52c-91edd872d539 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:57.531046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:57.565197 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fdc15-c50e-4e26-a001-d3edfce511ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:57.565999 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fdc15-c50e-4e26-a001-d3edfce511ec None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:57.566281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fdc15-c50e-4e26-a001-d3edfce511ec None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:57.566566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fdc15-c50e-4e26-a001-d3edfce511ec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:57.570444 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fb397-3cda-48e8-9121-969448a0f1e4 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:57.574414 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fdc15-c50e-4e26-a001-d3edfce511ec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:57.576145 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fdc15-c50e-4e26-a001-d3edfce511ec None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-a09fdc15-c50e-4e26-a001-d3edfce511ec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:40:57.594220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:57.595404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:57.596536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:57.596536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:57.596536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:40:57.596536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:40:57.596536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:40:57.596536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:40:57.596536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:40:57.596536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:40:57.596536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:40:57.596536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:57.596536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 259/512] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:40:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:57.597241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fdc15-c50e-4e26-a001-d3edfce511ec None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:57.609512 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ae96c-8023-40b7-97b3-5999035213a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:57.610312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ae96c-8023-40b7-97b3-5999035213a3 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:57.610597 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ae96c-8023-40b7-97b3-5999035213a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:57.610873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ae96c-8023-40b7-97b3-5999035213a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:57.624249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ae96c-8023-40b7-97b3-5999035213a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:57.625741 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ae96c-8023-40b7-97b3-5999035213a3 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-423ae96c-8023-40b7-97b3-5999035213a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:57.643837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:57.644949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:57.645830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:57.645830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:57.645830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:57.645830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:57.645830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 254/513] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:57.646292 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ae96c-8023-40b7-97b3-5999035213a3 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:57.674037 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:57.708974 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fdc15-c50e-4e26-a001-d3edfce511ec None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:57.744784 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481296a1-d935-4c70-bdb0-faeaeb81b78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:57.745454 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481296a1-d935-4c70-bdb0-faeaeb81b78b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:57.745738 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481296a1-d935-4c70-bdb0-faeaeb81b78b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:57.746014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481296a1-d935-4c70-bdb0-faeaeb81b78b None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:57.746958 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481296a1-d935-4c70-bdb0-faeaeb81b78b None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:57.747271 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481296a1-d935-4c70-bdb0-faeaeb81b78b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:57.748732 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481296a1-d935-4c70-bdb0-faeaeb81b78b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:57.750246 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ae96c-8023-40b7-97b3-5999035213a3 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:57.756771 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 260/514] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:40:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:57.757739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481296a1-d935-4c70-bdb0-faeaeb81b78b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:57.771545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:57.787080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1582c-0c32-414f-b2d0-4914c084bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:57.787744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1582c-0c32-414f-b2d0-4914c084bc79 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:57.788030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1582c-0c32-414f-b2d0-4914c084bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:57.788338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1582c-0c32-414f-b2d0-4914c084bc79 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:57.789055 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1582c-0c32-414f-b2d0-4914c084bc79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:57.790511 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1582c-0c32-414f-b2d0-4914c084bc79 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:57.810964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 255/515] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:40:57 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:40:57.812696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1582c-0c32-414f-b2d0-4914c084bc79 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:57.882816 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481296a1-d935-4c70-bdb0-faeaeb81b78b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:57.924469 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:57.930067 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f766b-9b90-4833-8dfa-b45c9fc95ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:57.931042 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f766b-9b90-4833-8dfa-b45c9fc95ef0 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:57.931221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f766b-9b90-4833-8dfa-b45c9fc95ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:57.931744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f766b-9b90-4833-8dfa-b45c9fc95ef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:57.943171 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f766b-9b90-4833-8dfa-b45c9fc95ef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:57.944721 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f766b-9b90-4833-8dfa-b45c9fc95ef0 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:57.962203 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1582c-0c32-414f-b2d0-4914c084bc79 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-be6f766b-9b90-4833-8dfa-b45c9fc95ef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:57.963996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:57.965560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:57.966496 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:57.966496 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:57.966496 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:57.966496 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:57.966496 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 261/516] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:57.968378 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f766b-9b90-4833-8dfa-b45c9fc95ef0 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:58.010279 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb714a-2bbf-41ab-a728-bb5a043e8f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:58.010973 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb714a-2bbf-41ab-a728-bb5a043e8f75 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:58.011321 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb714a-2bbf-41ab-a728-bb5a043e8f75 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:58.011607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb714a-2bbf-41ab-a728-bb5a043e8f75 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:58.012644 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb714a-2bbf-41ab-a728-bb5a043e8f75 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:58.012962 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb714a-2bbf-41ab-a728-bb5a043e8f75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:58.014429 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb714a-2bbf-41ab-a728-bb5a043e8f75 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:58.033826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 256/517] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 13:40:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:58.034738 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb714a-2bbf-41ab-a728-bb5a043e8f75 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:58.079336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:58.090923 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f766b-9b90-4833-8dfa-b45c9fc95ef0 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:58.127670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad83e62-3ca8-40ed-bce7-5f8a2dd18bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:58.128622 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad83e62-3ca8-40ed-bce7-5f8a2dd18bb7 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:58.128771 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad83e62-3ca8-40ed-bce7-5f8a2dd18bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:58.129016 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad83e62-3ca8-40ed-bce7-5f8a2dd18bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:58.129747 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad83e62-3ca8-40ed-bce7-5f8a2dd18bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:58.130056 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad83e62-3ca8-40ed-bce7-5f8a2dd18bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:58.131446 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad83e62-3ca8-40ed-bce7-5f8a2dd18bb7 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:58.145136 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 262/518] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:58.146046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad83e62-3ca8-40ed-bce7-5f8a2dd18bb7 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:58.160658 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb714a-2bbf-41ab-a728-bb5a043e8f75 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:58.197317 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5ce24-c857-4f1c-9446-71575fdadf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:58.197523 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:58.198028 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5ce24-c857-4f1c-9446-71575fdadf62 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:58.198316 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5ce24-c857-4f1c-9446-71575fdadf62 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:58.198631 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5ce24-c857-4f1c-9446-71575fdadf62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:58.209885 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5ce24-c857-4f1c-9446-71575fdadf62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:58.211362 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5ce24-c857-4f1c-9446-71575fdadf62 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-47d5ce24-c857-4f1c-9446-71575fdadf62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:58.230030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:58.230960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:58.231800 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:58.231800 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:58.231800 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:58.231800 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:58.231800 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 257/519] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:58.232066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5ce24-c857-4f1c-9446-71575fdadf62 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:58.264688 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad83e62-3ca8-40ed-bce7-5f8a2dd18bb7 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:58.302786 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7eebf7-9bcc-4e59-a678-aeee4a66c6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:58.303518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7eebf7-9bcc-4e59-a678-aeee4a66c6c1 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:58.303741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7eebf7-9bcc-4e59-a678-aeee4a66c6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:58.304011 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7eebf7-9bcc-4e59-a678-aeee4a66c6c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:58.304772 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7eebf7-9bcc-4e59-a678-aeee4a66c6c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:58.305093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7eebf7-9bcc-4e59-a678-aeee4a66c6c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:58.306490 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7eebf7-9bcc-4e59-a678-aeee4a66c6c1 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:58.318465 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 263/520] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:58.323837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7eebf7-9bcc-4e59-a678-aeee4a66c6c1 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:58.325611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:58.343956 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5ce24-c857-4f1c-9446-71575fdadf62 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:58.383952 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4e44c-bda5-4827-9a1f-5a9db6fea364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:58.384643 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4e44c-bda5-4827-9a1f-5a9db6fea364 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:58.384934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4e44c-bda5-4827-9a1f-5a9db6fea364 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:58.385214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4e44c-bda5-4827-9a1f-5a9db6fea364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:58.443454 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7eebf7-9bcc-4e59-a678-aeee4a66c6c1 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:58.446885 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:58.459443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4e44c-bda5-4827-9a1f-5a9db6fea364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:58.461266 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4e44c-bda5-4827-9a1f-5a9db6fea364 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:58.483266 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a95817-d944-496b-86d8-bbbbbfac78f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:58.484073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a95817-d944-496b-86d8-bbbbbfac78f0 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:58.484855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a95817-d944-496b-86d8-bbbbbfac78f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:58.485148 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a95817-d944-496b-86d8-bbbbbfac78f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:58.492372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a95817-d944-496b-86d8-bbbbbfac78f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:58.493868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a95817-d944-496b-86d8-bbbbbfac78f0 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-24a95817-d944-496b-86d8-bbbbbfac78f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:40:58.509844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:58.510760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:58.512620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:40:58.512620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:40:58.512620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:40:58.512620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:40:58.512620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:40:58.512620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:40:58.512620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:58.512620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:58.516288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 264/521] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:58.517144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a95817-d944-496b-86d8-bbbbbfac78f0 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:58.558964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:58.583355 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 258/522] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:40:58.583355 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4e44c-bda5-4827-9a1f-5a9db6fea364 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:58.637003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a95817-d944-496b-86d8-bbbbbfac78f0 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:58.675841 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ae6cb-a6a5-4b37-825d-24cf7f8d0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:58.676553 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ae6cb-a6a5-4b37-825d-24cf7f8d0431 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:58.676840 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ae6cb-a6a5-4b37-825d-24cf7f8d0431 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:58.677123 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ae6cb-a6a5-4b37-825d-24cf7f8d0431 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:58.677866 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ae6cb-a6a5-4b37-825d-24cf7f8d0431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:58.678179 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ae6cb-a6a5-4b37-825d-24cf7f8d0431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:58.679578 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ae6cb-a6a5-4b37-825d-24cf7f8d0431 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:58.691905 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 265/523] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:58.692626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ae6cb-a6a5-4b37-825d-24cf7f8d0431 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:58.698400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4e44c-bda5-4827-9a1f-5a9db6fea364 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:58.726788 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:58.748426 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbf8de-c5cc-4299-818f-84b2227b3092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:58.749255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbf8de-c5cc-4299-818f-84b2227b3092 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:58.749515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbf8de-c5cc-4299-818f-84b2227b3092 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:58.750824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbf8de-c5cc-4299-818f-84b2227b3092 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:58.760556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbf8de-c5cc-4299-818f-84b2227b3092 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:58.762156 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbf8de-c5cc-4299-818f-84b2227b3092 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-0acbf8de-c5cc-4299-818f-84b2227b3092 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:40:58.777125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:58.778697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:58.779650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:40:58.779650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:40:58.779650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:40:58.779650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:40:58.779650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:40:58.779650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:40:58.779650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:58.779650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:58.779650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 259/524] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:58.780610 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbf8de-c5cc-4299-818f-84b2227b3092 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:58.818699 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ae6cb-a6a5-4b37-825d-24cf7f8d0431 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:58.836409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:58.864232 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cdc7c-20bf-4c2d-b10c-b784353fe7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:58.865245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cdc7c-20bf-4c2d-b10c-b784353fe7bd None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:58.865531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cdc7c-20bf-4c2d-b10c-b784353fe7bd None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:58.865812 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cdc7c-20bf-4c2d-b10c-b784353fe7bd None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:58.866611 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cdc7c-20bf-4c2d-b10c-b784353fe7bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:58.866927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cdc7c-20bf-4c2d-b10c-b784353fe7bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:58.868643 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cdc7c-20bf-4c2d-b10c-b784353fe7bd None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:58.893446 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 266/525] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:58.893446 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cdc7c-20bf-4c2d-b10c-b784353fe7bd None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:58.903702 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbf8de-c5cc-4299-818f-84b2227b3092 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:58.947756 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fcef7-e06f-4f82-8d3b-7dbfb11cdfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:58.948957 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fcef7-e06f-4f82-8d3b-7dbfb11cdfc5 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:58.949850 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fcef7-e06f-4f82-8d3b-7dbfb11cdfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:58.950415 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fcef7-e06f-4f82-8d3b-7dbfb11cdfc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:58.965887 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fcef7-e06f-4f82-8d3b-7dbfb11cdfc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:58.967452 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fcef7-e06f-4f82-8d3b-7dbfb11cdfc5 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-bc2fcef7-e06f-4f82-8d3b-7dbfb11cdfc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:58.999048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:59.000943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:59.008391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:59.008391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:59.008391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:59.008391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:40:59.008391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 260/526] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:59.008391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fcef7-e06f-4f82-8d3b-7dbfb11cdfc5 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:59.026650 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:59.047368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cdc7c-20bf-4c2d-b10c-b784353fe7bd None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:59.096150 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82aaa8-4dda-4d93-929a-a01a7b887912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:59.097038 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82aaa8-4dda-4d93-929a-a01a7b887912 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:59.097248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82aaa8-4dda-4d93-929a-a01a7b887912 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:59.097536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82aaa8-4dda-4d93-929a-a01a7b887912 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:59.106685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82aaa8-4dda-4d93-929a-a01a7b887912 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:59.108229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82aaa8-4dda-4d93-929a-a01a7b887912 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:59.122617 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-bf82aaa8-4dda-4d93-929a-a01a7b887912 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:40:59.125919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:59.126847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:59.132978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:59.132978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:59.132978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:40:59.132978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:40:59.132978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:40:59.132978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:40:59.132978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:40:59.132978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:40:59.132978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:40:59.132978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:59.132978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 267/527] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:40:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:59.133696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fcef7-e06f-4f82-8d3b-7dbfb11cdfc5 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:59.133796 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82aaa8-4dda-4d93-929a-a01a7b887912 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:59.178518 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55838a35-6c1d-482d-abc6-8fec4af57509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:59.179427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55838a35-6c1d-482d-abc6-8fec4af57509 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:59.179862 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55838a35-6c1d-482d-abc6-8fec4af57509 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:59.180407 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55838a35-6c1d-482d-abc6-8fec4af57509 None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:59.181321 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55838a35-6c1d-482d-abc6-8fec4af57509 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:59.181670 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55838a35-6c1d-482d-abc6-8fec4af57509 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:59.183122 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55838a35-6c1d-482d-abc6-8fec4af57509 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:59.202584 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 261/528] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:59.203472 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55838a35-6c1d-482d-abc6-8fec4af57509 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:59.292664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82aaa8-4dda-4d93-929a-a01a7b887912 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:59.335762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f8a7c-125d-48da-a8f7-a51054c8a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:59.336468 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f8a7c-125d-48da-a8f7-a51054c8a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:59.336755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f8a7c-125d-48da-a8f7-a51054c8a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:59.337032 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f8a7c-125d-48da-a8f7-a51054c8a1a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:59.337890 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f8a7c-125d-48da-a8f7-a51054c8a1a3 None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=62fbf54d04f84afd8dd9270b17207b04) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:59.338207 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f8a7c-125d-48da-a8f7-a51054c8a1a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:59.340258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f8a7c-125d-48da-a8f7-a51054c8a1a3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:59.349554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55838a35-6c1d-482d-abc6-8fec4af57509 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:59.349915 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 268/529] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:59 2022] GET /identity/v3/role_assignments?user.id=62fbf54d04f84afd8dd9270b17207b04&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:59.352143 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f8a7c-125d-48da-a8f7-a51054c8a1a3 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:59.380906 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:59.411617 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c90b8-46bb-4f1b-ab12-ea5734087a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:59.412940 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c90b8-46bb-4f1b-ab12-ea5734087a67 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:59.413493 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c90b8-46bb-4f1b-ab12-ea5734087a67 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:59.413951 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c90b8-46bb-4f1b-ab12-ea5734087a67 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:59.414887 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c90b8-46bb-4f1b-ab12-ea5734087a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:59.415350 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c90b8-46bb-4f1b-ab12-ea5734087a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:59.417107 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c90b8-46bb-4f1b-ab12-ea5734087a67 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:59.439799 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 262/530] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:59.442743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c90b8-46bb-4f1b-ab12-ea5734087a67 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:59.482317 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:59.559981 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f8a7c-125d-48da-a8f7-a51054c8a1a3 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:59.630483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830dcd8-594f-4b9e-8fde-d5fc7555b52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:59.631347 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830dcd8-594f-4b9e-8fde-d5fc7555b52e None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:59.631751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830dcd8-594f-4b9e-8fde-d5fc7555b52e None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:59.632142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830dcd8-594f-4b9e-8fde-d5fc7555b52e None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:59.633248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830dcd8-594f-4b9e-8fde-d5fc7555b52e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:59.634099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830dcd8-594f-4b9e-8fde-d5fc7555b52e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:59.635331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830dcd8-594f-4b9e-8fde-d5fc7555b52e None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:59.649423 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c90b8-46bb-4f1b-ab12-ea5734087a67 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:59.685704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 269/531] 10.222.0.24 () {56 vars in 1139 bytes} [Wed May 25 13:40:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:59.686818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830dcd8-594f-4b9e-8fde-d5fc7555b52e None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:59.695298 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6b253-6817-4e8f-a9f8-52495e8d1b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:59.696821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6b253-6817-4e8f-a9f8-52495e8d1b04 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:59.697288 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6b253-6817-4e8f-a9f8-52495e8d1b04 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:59.697709 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6b253-6817-4e8f-a9f8-52495e8d1b04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:59.698713 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6b253-6817-4e8f-a9f8-52495e8d1b04 None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=971eae8a8ad44ce893c311b74acbd76b) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:59.708006 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6b253-6817-4e8f-a9f8-52495e8d1b04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:59.708006 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6b253-6817-4e8f-a9f8-52495e8d1b04 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:59.717975 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 263/532] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:40:59 2022] GET /identity/v3/role_assignments?user.id=971eae8a8ad44ce893c311b74acbd76b&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:59.719086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6b253-6817-4e8f-a9f8-52495e8d1b04 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:59.779559 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:59.819520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:59.821118 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830dcd8-594f-4b9e-8fde-d5fc7555b52e None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:59.850592 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6b253-6817-4e8f-a9f8-52495e8d1b04 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:59.869970 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb001d2-3674-41d0-8388-5ac13746f706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:59.870794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb001d2-3674-41d0-8388-5ac13746f706 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:59.871129 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb001d2-3674-41d0-8388-5ac13746f706 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:59.871474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb001d2-3674-41d0-8388-5ac13746f706 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:59.888632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb001d2-3674-41d0-8388-5ac13746f706 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:59.890201 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb001d2-3674-41d0-8388-5ac13746f706 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:59.893934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514793d-cbe0-40e7-a546-2c08c6a2a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:59.894880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514793d-cbe0-40e7-a546-2c08c6a2a947 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:59.895397 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514793d-cbe0-40e7-a546-2c08c6a2a947 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:59.895897 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514793d-cbe0-40e7-a546-2c08c6a2a947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-fdb001d2-3674-41d0-8388-5ac13746f706 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:40:59.923252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:59.924526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:59.925380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:40:59.925380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:40:59.925380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:40:59.925380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:40:59.925380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:40:59.925380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:40:59.925380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:59.925380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:40:59.935758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 270/533] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:40:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:59.942290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb001d2-3674-41d0-8388-5ac13746f706 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:00.046563 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514793d-cbe0-40e7-a546-2c08c6a2a947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:00.048453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514793d-cbe0-40e7-a546-2c08c6a2a947 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:00.132342 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb001d2-3674-41d0-8388-5ac13746f706 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:00.164591 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:00.181778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:00.187285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 264/534] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:40:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:41:00.203998 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81220be-0ba1-4efd-9abf-a6d5b27382ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:00.204745 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81220be-0ba1-4efd-9abf-a6d5b27382ab None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:00.205663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514793d-cbe0-40e7-a546-2c08c6a2a947 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:00.212687 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81220be-0ba1-4efd-9abf-a6d5b27382ab None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:00.212974 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81220be-0ba1-4efd-9abf-a6d5b27382ab None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:00.213849 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81220be-0ba1-4efd-9abf-a6d5b27382ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:00.214169 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81220be-0ba1-4efd-9abf-a6d5b27382ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:00.216334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81220be-0ba1-4efd-9abf-a6d5b27382ab None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:00.243029 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 271/535] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:00.249169 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81220be-0ba1-4efd-9abf-a6d5b27382ab None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:00.320885 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514793d-cbe0-40e7-a546-2c08c6a2a947 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:00.375587 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402358d-b4fb-456d-8d77-2342aae87c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:00.376443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402358d-b4fb-456d-8d77-2342aae87c4e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:00.376724 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402358d-b4fb-456d-8d77-2342aae87c4e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:00.376995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402358d-b4fb-456d-8d77-2342aae87c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:00.390652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402358d-b4fb-456d-8d77-2342aae87c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:00.392429 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402358d-b4fb-456d-8d77-2342aae87c4e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-d402358d-b4fb-456d-8d77-2342aae87c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:00.413409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:00.414607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:00.415688 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:00.415688 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:00.415688 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:00.415688 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:00.417665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 265/536] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:00.419501 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2189951-0b54-487e-8f84-5df013088cf1 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:00.419961 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2189951-0b54-487e-8f84-5df013088cf1 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:00.420406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2189951-0b54-487e-8f84-5df013088cf1 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:00.420896 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81220be-0ba1-4efd-9abf-a6d5b27382ab None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:00.422323 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 266/537] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:00.423193 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2189951-0b54-487e-8f84-5df013088cf1 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:00.462550 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:00.465813 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35145dca-ace1-4df9-b246-8828800ecd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:00.467463 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145dca-ace1-4df9-b246-8828800ecd94 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:00.467755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145dca-ace1-4df9-b246-8828800ecd94 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:00.468027 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145dca-ace1-4df9-b246-8828800ecd94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:00.468926 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35145dca-ace1-4df9-b246-8828800ecd94 None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=ac053a5b34cb4fd8a4fb8b0dfa80e922) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:00.469241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35145dca-ace1-4df9-b246-8828800ecd94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:00.470724 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35145dca-ace1-4df9-b246-8828800ecd94 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:00.477748 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 272/538] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:00 2022] GET /identity/v3/role_assignments?user.id=ac053a5b34cb4fd8a4fb8b0dfa80e922&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:00.479113 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db360d-2a7c-427a-a22c-dc6746301ea1 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:00.479405 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db360d-2a7c-427a-a22c-dc6746301ea1 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:00.479680 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db360d-2a7c-427a-a22c-dc6746301ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:00.499377 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-b4db360d-2a7c-427a-a22c-dc6746301ea1 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:00.508160 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-b4db360d-2a7c-427a-a22c-dc6746301ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:00.560682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2189951-0b54-487e-8f84-5df013088cf1 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:00.616949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:00.651466 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff716103-ad42-4b8b-8b8d-5585b60c4f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:00.652955 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff716103-ad42-4b8b-8b8d-5585b60c4f0a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:00.654914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff716103-ad42-4b8b-8b8d-5585b60c4f0a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:00.655761 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff716103-ad42-4b8b-8b8d-5585b60c4f0a None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:00.657777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff716103-ad42-4b8b-8b8d-5585b60c4f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:00.659735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff716103-ad42-4b8b-8b8d-5585b60c4f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:00.661400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff716103-ad42-4b8b-8b8d-5585b60c4f0a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:00.677560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 273/539] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:00.686576 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 267/540] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:00.692246 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db360d-2a7c-427a-a22c-dc6746301ea1 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:00.721856 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff716103-ad42-4b8b-8b8d-5585b60c4f0a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:00.878641 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:00.888062 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff716103-ad42-4b8b-8b8d-5585b60c4f0a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:00.918897 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db360d-2a7c-427a-a22c-dc6746301ea1 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:00.944060 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d72b69-eb22-4e89-9504-67733840a858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:00.944934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d72b69-eb22-4e89-9504-67733840a858 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:00.945222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d72b69-eb22-4e89-9504-67733840a858 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:00.945502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d72b69-eb22-4e89-9504-67733840a858 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:00.970147 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d72b69-eb22-4e89-9504-67733840a858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-f1d72b69-eb22-4e89-9504-67733840a858 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:00.985721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:00.986833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:00.987682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 268/541] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:00.993130 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d72b69-eb22-4e89-9504-67733840a858 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:00.997603 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441ad3f-d50c-4e30-a3ac-ce09e35fd21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:00.998422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441ad3f-d50c-4e30-a3ac-ce09e35fd21d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:00.998710 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441ad3f-d50c-4e30-a3ac-ce09e35fd21d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:00.998983 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441ad3f-d50c-4e30-a3ac-ce09e35fd21d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:01.013868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441ad3f-d50c-4e30-a3ac-ce09e35fd21d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:01.015900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441ad3f-d50c-4e30-a3ac-ce09e35fd21d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-d441ad3f-d50c-4e30-a3ac-ce09e35fd21d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:01.040778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:01.041693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:01.042552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:01.042552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:01.042552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:01.042552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:01.042552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:01.042552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:01.042552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:01.042552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:01.048558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 274/542] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:01.053650 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441ad3f-d50c-4e30-a3ac-ce09e35fd21d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:01.142559 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:01.149429 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d72b69-eb22-4e89-9504-67733840a858 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:01.187446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fc5d4-2470-4088-bf02-f51fcb97bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:01.188651 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fc5d4-2470-4088-bf02-f51fcb97bc09 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:01.189176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fc5d4-2470-4088-bf02-f51fcb97bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:01.189934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fc5d4-2470-4088-bf02-f51fcb97bc09 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:01.190903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fc5d4-2470-4088-bf02-f51fcb97bc09 None admin] RBAC: Adding query filter params (name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:01.191427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fc5d4-2470-4088-bf02-f51fcb97bc09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:01.193437 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fc5d4-2470-4088-bf02-f51fcb97bc09 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:01.205414 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 269/543] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:01.211014 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fc5d4-2470-4088-bf02-f51fcb97bc09 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:01.252461 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:01.285188 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441ad3f-d50c-4e30-a3ac-ce09e35fd21d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:01.350199 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47cc63-e065-4d9c-8770-2a0ed5d4d056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:01.350877 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47cc63-e065-4d9c-8770-2a0ed5d4d056 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:01.351419 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47cc63-e065-4d9c-8770-2a0ed5d4d056 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:01.351696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47cc63-e065-4d9c-8770-2a0ed5d4d056 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:01.352527 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47cc63-e065-4d9c-8770-2a0ed5d4d056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:01.352847 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47cc63-e065-4d9c-8770-2a0ed5d4d056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:01.354308 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47cc63-e065-4d9c-8770-2a0ed5d4d056 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:01.369833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 275/544] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:01.375570 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47cc63-e065-4d9c-8770-2a0ed5d4d056 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:01.378306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fc5d4-2470-4088-bf02-f51fcb97bc09 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:01.448329 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5382d6-4c69-4272-9527-0f124ee5d6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:01.449704 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5382d6-4c69-4272-9527-0f124ee5d6e0 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:01.449993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5382d6-4c69-4272-9527-0f124ee5d6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:01.450272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5382d6-4c69-4272-9527-0f124ee5d6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:01.473492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5382d6-4c69-4272-9527-0f124ee5d6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:01.474995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5382d6-4c69-4272-9527-0f124ee5d6e0 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-5c5382d6-4c69-4272-9527-0f124ee5d6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:01.503064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:01.503984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:01.504880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:01.504880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:01.504880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:01.504880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:01.508048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 270/545] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:01.518943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5382d6-4c69-4272-9527-0f124ee5d6e0 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:01.576490 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:01.581373 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47cc63-e065-4d9c-8770-2a0ed5d4d056 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:01.645161 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79de1a-6b81-4c9e-8882-680b3c865f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:01.645839 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79de1a-6b81-4c9e-8882-680b3c865f39 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:01.646126 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79de1a-6b81-4c9e-8882-680b3c865f39 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:01.646399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79de1a-6b81-4c9e-8882-680b3c865f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:01.647248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79de1a-6b81-4c9e-8882-680b3c865f39 None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=e29f2382dd6f4f648c31f12240ba5793) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:01.647566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79de1a-6b81-4c9e-8882-680b3c865f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:01.649057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79de1a-6b81-4c9e-8882-680b3c865f39 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:01.660492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:01.667868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 276/546] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:01 2022] GET /identity/v3/role_assignments?user.id=e29f2382dd6f4f648c31f12240ba5793&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:01.718655 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5382d6-4c69-4272-9527-0f124ee5d6e0 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:01.781087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c5335-173b-4618-a85f-2906bac8674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:01.782197 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c5335-173b-4618-a85f-2906bac8674e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:01.782736 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c5335-173b-4618-a85f-2906bac8674e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:01.783367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c5335-173b-4618-a85f-2906bac8674e None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:01.784474 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c5335-173b-4618-a85f-2906bac8674e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:01.785014 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c5335-173b-4618-a85f-2906bac8674e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:01.786702 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c5335-173b-4618-a85f-2906bac8674e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:01.807799 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 271/547] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:01.813586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79de1a-6b81-4c9e-8882-680b3c865f39 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:01.955402 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79de1a-6b81-4c9e-8882-680b3c865f39 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:01.994634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fb672-ff44-4f2e-981a-0c3c477229ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:01.995454 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fb672-ff44-4f2e-981a-0c3c477229ff None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:01.995772 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fb672-ff44-4f2e-981a-0c3c477229ff None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:01.996057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fb672-ff44-4f2e-981a-0c3c477229ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:02.005764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fb672-ff44-4f2e-981a-0c3c477229ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:02.007352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fb672-ff44-4f2e-981a-0c3c477229ff None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-379fb672-ff44-4f2e-981a-0c3c477229ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:02.024426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:02.025914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:02.028489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:02.028489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:02.028489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:02.028489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:02.028489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:02.028489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:02.028489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:02.028489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:02.028489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:41:02.028489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:02.028489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 277/548] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:41:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:02.032172 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c5335-173b-4618-a85f-2906bac8674e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:02.177651 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c5335-173b-4618-a85f-2906bac8674e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:02.206493 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501f562-e52c-4797-95e9-694b0a8f90f6 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:02.206734 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501f562-e52c-4797-95e9-694b0a8f90f6 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:02.207128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501f562-e52c-4797-95e9-694b0a8f90f6 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:02.208852 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 278/549] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:02.213664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061b171-2dec-47b5-a46f-09781aaffce2 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:02.214025 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061b171-2dec-47b5-a46f-09781aaffce2 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:02.214369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061b171-2dec-47b5-a46f-09781aaffce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:02.228491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:02.236518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-c061b171-2dec-47b5-a46f-09781aaffce2 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:02.237061 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d678f3-553d-4570-84d0-cbfe2719d0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:02.237800 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d678f3-553d-4570-84d0-cbfe2719d0cd None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:02.237923 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-c061b171-2dec-47b5-a46f-09781aaffce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:02.238079 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d678f3-553d-4570-84d0-cbfe2719d0cd None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:02.238369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d678f3-553d-4570-84d0-cbfe2719d0cd None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:02.239234 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d678f3-553d-4570-84d0-cbfe2719d0cd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:02.239561 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d678f3-553d-4570-84d0-cbfe2719d0cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:02.241047 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d678f3-553d-4570-84d0-cbfe2719d0cd None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:02.259887 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:02.270392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 272/550] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 13:41:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:02.276901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d678f3-553d-4570-84d0-cbfe2719d0cd None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:02.366579 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 279/551] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:02.367956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9cf01-c870-4182-b87e-185efcccc0ce None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:02.368351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9cf01-c870-4182-b87e-185efcccc0ce None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:02.368630 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9cf01-c870-4182-b87e-185efcccc0ce None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:02.369924 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 280/552] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:02.376627 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105bbc7-c0e9-4eb3-8de3-4022d42fc708 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:02.376919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105bbc7-c0e9-4eb3-8de3-4022d42fc708 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:02.377206 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105bbc7-c0e9-4eb3-8de3-4022d42fc708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:02.397802 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-c105bbc7-c0e9-4eb3-8de3-4022d42fc708 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:02.399624 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-c105bbc7-c0e9-4eb3-8de3-4022d42fc708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:02.440769 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d678f3-553d-4570-84d0-cbfe2719d0cd None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:02.482901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520aa9e-4d26-4a56-95b2-b5f073f63312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:02.483474 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520aa9e-4d26-4a56-95b2-b5f073f63312 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:02.483761 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520aa9e-4d26-4a56-95b2-b5f073f63312 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:02.484039 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520aa9e-4d26-4a56-95b2-b5f073f63312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:02.496349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 281/553] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:02.497586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105bbc7-c0e9-4eb3-8de3-4022d42fc708 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:02.571270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:02.586960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520aa9e-4d26-4a56-95b2-b5f073f63312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:02.588513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520aa9e-4d26-4a56-95b2-b5f073f63312 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:02.614053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:02.632983 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105bbc7-c0e9-4eb3-8de3-4022d42fc708 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:02.672038 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa02e6-a3a5-4f29-a718-51e9a444d344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:02.673154 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa02e6-a3a5-4f29-a718-51e9a444d344 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:02.673641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa02e6-a3a5-4f29-a718-51e9a444d344 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:02.674060 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa02e6-a3a5-4f29-a718-51e9a444d344 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:02.686526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa02e6-a3a5-4f29-a718-51e9a444d344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-e7fa02e6-a3a5-4f29-a718-51e9a444d344 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:02.696238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:02.697351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:02.698298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:02.698298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:02.698298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:02.698298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:02.698298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:02.698298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:02.698298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:02.698298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:02.698298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:02.698298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:02.698298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:02.698298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:02.700809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 282/554] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:02.705024 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa02e6-a3a5-4f29-a718-51e9a444d344 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:02.708305 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 273/555] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:41:02.709475 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520aa9e-4d26-4a56-95b2-b5f073f63312 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:02.820045 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:02.847286 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520aa9e-4d26-4a56-95b2-b5f073f63312 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:02.847747 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa02e6-a3a5-4f29-a718-51e9a444d344 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:02.892681 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98086-50a4-4cb8-b526-359e193111cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:02.893823 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98086-50a4-4cb8-b526-359e193111cb None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:02.894110 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98086-50a4-4cb8-b526-359e193111cb None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:02.894388 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98086-50a4-4cb8-b526-359e193111cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:02.902869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1e8d0-3558-49af-8fa2-078e2d68ee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:02.903870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1e8d0-3558-49af-8fa2-078e2d68ee14 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:02.904707 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1e8d0-3558-49af-8fa2-078e2d68ee14 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:02.905144 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1e8d0-3558-49af-8fa2-078e2d68ee14 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:02.906534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1e8d0-3558-49af-8fa2-078e2d68ee14 None admin] RBAC: Adding query filter params (name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:02.907044 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1e8d0-3558-49af-8fa2-078e2d68ee14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:02.909059 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1e8d0-3558-49af-8fa2-078e2d68ee14 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:02.909226 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d98086-50a4-4cb8-b526-359e193111cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-69d98086-50a4-4cb8-b526-359e193111cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:02.919163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:02.920422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:02.921399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:02.921399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:02.921399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:02.921399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:02.921399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:02.921399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:02.921399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:02.921399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:02.921399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:02.921399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:02.921399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:02.921399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:02.922505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 274/556] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:02.923551 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1e8d0-3558-49af-8fa2-078e2d68ee14 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:02.932150 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 283/557] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:02.932150 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98086-50a4-4cb8-b526-359e193111cb None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:02.935547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:03.063037 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98086-50a4-4cb8-b526-359e193111cb None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:03.068832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1e8d0-3558-49af-8fa2-078e2d68ee14 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:03.106082 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f747d-c028-4db9-9217-e466dd66d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:03.107188 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f747d-c028-4db9-9217-e466dd66d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:03.107188 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f747d-c028-4db9-9217-e466dd66d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:03.107339 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f747d-c028-4db9-9217-e466dd66d2c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:03.108560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f747d-c028-4db9-9217-e466dd66d2c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:03.108560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f747d-c028-4db9-9217-e466dd66d2c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:03.109783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f747d-c028-4db9-9217-e466dd66d2c0 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:03.117410 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cf3f1-821b-48e5-ab8d-457b3eace1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:03.118207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf3f1-821b-48e5-ab8d-457b3eace1d3 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:03.123815 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf3f1-821b-48e5-ab8d-457b3eace1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:03.124383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 284/558] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:03.124548 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf3f1-821b-48e5-ab8d-457b3eace1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:03.124647 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f747d-c028-4db9-9217-e466dd66d2c0 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:03.138805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cf3f1-821b-48e5-ab8d-457b3eace1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:03.140892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cf3f1-821b-48e5-ab8d-457b3eace1d3 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:03.149267 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-159cf3f1-821b-48e5-ab8d-457b3eace1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:03.160847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:03.161790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:03.162673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:03.162673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:03.162673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:03.162673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:03.162673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 275/559] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:03.163387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc6c63-b556-4be5-b2f2-3bacd73d2184 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:03.163667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc6c63-b556-4be5-b2f2-3bacd73d2184 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:03.163852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc6c63-b556-4be5-b2f2-3bacd73d2184 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:03.170615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 276/560] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:03.170615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc6c63-b556-4be5-b2f2-3bacd73d2184 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:03.216005 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:03.269148 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f747d-c028-4db9-9217-e466dd66d2c0 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:03.300653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc6c63-b556-4be5-b2f2-3bacd73d2184 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:03.310583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26433528-0eac-416d-aa39-3f4f5046201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:03.311607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26433528-0eac-416d-aa39-3f4f5046201e None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:03.311607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26433528-0eac-416d-aa39-3f4f5046201e None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:03.311855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26433528-0eac-416d-aa39-3f4f5046201e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:03.327948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26433528-0eac-416d-aa39-3f4f5046201e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:03.329310 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26433528-0eac-416d-aa39-3f4f5046201e None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:03.352916 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0229f5-6da6-44e2-8b32-ac71dca2cbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:03.354136 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0229f5-6da6-44e2-8b32-ac71dca2cbf0 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:03.354587 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0229f5-6da6-44e2-8b32-ac71dca2cbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:03.355525 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0229f5-6da6-44e2-8b32-ac71dca2cbf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-26433528-0eac-416d-aa39-3f4f5046201e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:03.355945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:03.357208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:03.358102 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:03.358102 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:03.358102 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:03.358102 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:03.358102 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 285/561] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:03.359178 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26433528-0eac-416d-aa39-3f4f5046201e None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:03.379199 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0229f5-6da6-44e2-8b32-ac71dca2cbf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:03.382338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0229f5-6da6-44e2-8b32-ac71dca2cbf0 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-cc0229f5-6da6-44e2-8b32-ac71dca2cbf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:03.413728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:03.414689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:03.415694 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:03.415694 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:03.415694 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:03.415694 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:03.420651 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 277/562] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:03.422574 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254949a6-6499-40da-80a6-1c9905c7110b None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:03.422574 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254949a6-6499-40da-80a6-1c9905c7110b None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:03.422780 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254949a6-6499-40da-80a6-1c9905c7110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:03.442205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-254949a6-6499-40da-80a6-1c9905c7110b None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:03.443438 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-254949a6-6499-40da-80a6-1c9905c7110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:03.501281 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:03.507361 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26433528-0eac-416d-aa39-3f4f5046201e None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:03.525447 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:03.526821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 278/563] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:03.527993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254949a6-6499-40da-80a6-1c9905c7110b None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:03.553770 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf29eb-4e74-474f-a792-c3a0b99e8461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:03.555163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf29eb-4e74-474f-a792-c3a0b99e8461 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:03.555627 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf29eb-4e74-474f-a792-c3a0b99e8461 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:03.555906 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf29eb-4e74-474f-a792-c3a0b99e8461 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:03.556686 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf29eb-4e74-474f-a792-c3a0b99e8461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:03.556999 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf29eb-4e74-474f-a792-c3a0b99e8461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:03.559508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf29eb-4e74-474f-a792-c3a0b99e8461 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:03.572499 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 286/564] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:03.573181 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf29eb-4e74-474f-a792-c3a0b99e8461 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:03.653162 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254949a6-6499-40da-80a6-1c9905c7110b None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:03.691241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf29eb-4e74-474f-a792-c3a0b99e8461 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:03.696959 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f1391-b50b-4f76-b426-78ba86a57267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:03.698120 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f1391-b50b-4f76-b426-78ba86a57267 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:03.698234 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f1391-b50b-4f76-b426-78ba86a57267 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:03.698442 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f1391-b50b-4f76-b426-78ba86a57267 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:03.699250 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f1391-b50b-4f76-b426-78ba86a57267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:03.699556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f1391-b50b-4f76-b426-78ba86a57267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:03.703222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f1391-b50b-4f76-b426-78ba86a57267 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:03.717146 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 279/565] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:03.718399 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f1391-b50b-4f76-b426-78ba86a57267 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:03.743511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8577f77-bb5a-45e5-b7ba-790fb44f1ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:03.744518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8577f77-bb5a-45e5-b7ba-790fb44f1ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:03.744804 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8577f77-bb5a-45e5-b7ba-790fb44f1ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:03.745080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8577f77-bb5a-45e5-b7ba-790fb44f1ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:03.745853 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8577f77-bb5a-45e5-b7ba-790fb44f1ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:03.746586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8577f77-bb5a-45e5-b7ba-790fb44f1ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:03.748047 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8577f77-bb5a-45e5-b7ba-790fb44f1ea9 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:03.766247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 287/566] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:03.766247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8577f77-bb5a-45e5-b7ba-790fb44f1ea9 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:03.780363 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:03.816788 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:03.849774 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f1391-b50b-4f76-b426-78ba86a57267 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:03.898477 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0188d28-6950-46b5-8f23-cd76a1635a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:03.899777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0188d28-6950-46b5-8f23-cd76a1635a71 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:03.900291 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0188d28-6950-46b5-8f23-cd76a1635a71 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:03.900892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0188d28-6950-46b5-8f23-cd76a1635a71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:03.905148 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8577f77-bb5a-45e5-b7ba-790fb44f1ea9 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:03.916039 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0188d28-6950-46b5-8f23-cd76a1635a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-a0188d28-6950-46b5-8f23-cd76a1635a71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:03.927287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:03.928310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:03.929161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:03.929161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:03.929161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:03.929161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:03.929161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:03.929161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:03.929161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:03.929161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:03.929161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:03.929161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:03.929161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:03.929161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:03.929796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 280/567] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:03.930511 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0188d28-6950-46b5-8f23-cd76a1635a71 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:03.951407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bf7a7-bd3b-4c38-9579-48b04354b9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:03.952533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bf7a7-bd3b-4c38-9579-48b04354b9c1 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:03.952984 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bf7a7-bd3b-4c38-9579-48b04354b9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:03.953267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bf7a7-bd3b-4c38-9579-48b04354b9c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:03.961006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bf7a7-bd3b-4c38-9579-48b04354b9c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:03.962675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bf7a7-bd3b-4c38-9579-48b04354b9c1 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-338bf7a7-bd3b-4c38-9579-48b04354b9c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:03.979255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:03.981046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:03.982728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:03.982728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:03.982728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:03.982728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:03.982728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:03.982728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:03.982728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:03.982728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:03.982728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 288/568] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:03.982728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bf7a7-bd3b-4c38-9579-48b04354b9c1 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:04.065705 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0188d28-6950-46b5-8f23-cd76a1635a71 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:04.067375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:04.114517 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212bf5-d53a-46fe-abf0-c93e058422b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:04.115377 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212bf5-d53a-46fe-abf0-c93e058422b9 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:04.115699 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212bf5-d53a-46fe-abf0-c93e058422b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:04.115928 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212bf5-d53a-46fe-abf0-c93e058422b9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:04.121545 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:04.128256 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bf7a7-bd3b-4c38-9579-48b04354b9c1 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:04.130589 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f212bf5-d53a-46fe-abf0-c93e058422b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:04.132155 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f212bf5-d53a-46fe-abf0-c93e058422b9 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-2f212bf5-d53a-46fe-abf0-c93e058422b9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:04.153198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:04.154375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:04.155392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:04.155392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:04.155392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:04.155392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:04.155392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:04.155392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:04.155392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:04.155392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:04.155392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 13:41:04.155392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:04.155392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 281/569] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:41:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:04.156045 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212bf5-d53a-46fe-abf0-c93e058422b9 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:04.178805 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a2967-241d-4b3b-b70a-4e1d2756d091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:04.179613 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a2967-241d-4b3b-b70a-4e1d2756d091 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:04.179895 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a2967-241d-4b3b-b70a-4e1d2756d091 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:04.180194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a2967-241d-4b3b-b70a-4e1d2756d091 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:04.188609 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a2967-241d-4b3b-b70a-4e1d2756d091 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:04.190088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a2967-241d-4b3b-b70a-4e1d2756d091 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-420a2967-241d-4b3b-b70a-4e1d2756d091 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:04.207338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:04.208433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:04.209489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:04.209489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:04.209489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:04.209489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:04.209489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:04.209489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:04.209489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:04.209489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:04.209489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:41:04.209489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:04.209489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 289/570] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 13:41:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:04.210099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a2967-241d-4b3b-b70a-4e1d2756d091 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:04.290508 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212bf5-d53a-46fe-abf0-c93e058422b9 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:04.329033 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d127f52-b6b3-4634-b8dd-31024956a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:04.331234 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a2967-241d-4b3b-b70a-4e1d2756d091 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:04.331373 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d127f52-b6b3-4634-b8dd-31024956a28e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:04.331373 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d127f52-b6b3-4634-b8dd-31024956a28e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:04.331373 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d127f52-b6b3-4634-b8dd-31024956a28e None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:04.331373 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d127f52-b6b3-4634-b8dd-31024956a28e None admin] RBAC: Adding query filter params (name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:04.331373 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d127f52-b6b3-4634-b8dd-31024956a28e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:04.333512 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d127f52-b6b3-4634-b8dd-31024956a28e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:04.342062 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 282/571] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:04.342916 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d127f52-b6b3-4634-b8dd-31024956a28e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:04.372933 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87a71c-f2e3-4bb8-9a97-3544f2a3c3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:04.373599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87a71c-f2e3-4bb8-9a97-3544f2a3c3a2 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:04.374169 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87a71c-f2e3-4bb8-9a97-3544f2a3c3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:04.374284 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:04.374372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87a71c-f2e3-4bb8-9a97-3544f2a3c3a2 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:04.374942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87a71c-f2e3-4bb8-9a97-3544f2a3c3a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:04.375235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87a71c-f2e3-4bb8-9a97-3544f2a3c3a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:04.376888 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87a71c-f2e3-4bb8-9a97-3544f2a3c3a2 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:04.389578 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 290/572] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:04.390434 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87a71c-f2e3-4bb8-9a97-3544f2a3c3a2 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:04.414704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:04.459427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d127f52-b6b3-4634-b8dd-31024956a28e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:04.494493 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce45d56-b983-47fd-9caf-5996b2d23a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:04.495267 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce45d56-b983-47fd-9caf-5996b2d23a02 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:04.496071 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce45d56-b983-47fd-9caf-5996b2d23a02 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:04.496537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce45d56-b983-47fd-9caf-5996b2d23a02 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:04.497394 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce45d56-b983-47fd-9caf-5996b2d23a02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:04.497699 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce45d56-b983-47fd-9caf-5996b2d23a02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:04.499128 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce45d56-b983-47fd-9caf-5996b2d23a02 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:04.505170 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87a71c-f2e3-4bb8-9a97-3544f2a3c3a2 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:04.517480 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 283/573] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 13:41:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:04.518793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f93a9-4cdb-49fe-84f8-ace1a3868ccf None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:04.519084 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f93a9-4cdb-49fe-84f8-ace1a3868ccf None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:04.519362 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f93a9-4cdb-49fe-84f8-ace1a3868ccf None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:04.520622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 284/574] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:04.521312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f93a9-4cdb-49fe-84f8-ace1a3868ccf None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:04.548015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8fd60-12a6-49a6-98de-0c37768ddb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:04.548765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8fd60-12a6-49a6-98de-0c37768ddb54 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:04.549046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8fd60-12a6-49a6-98de-0c37768ddb54 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:04.549321 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8fd60-12a6-49a6-98de-0c37768ddb54 None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:04.550159 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8fd60-12a6-49a6-98de-0c37768ddb54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:04.550468 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8fd60-12a6-49a6-98de-0c37768ddb54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:04.551912 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8fd60-12a6-49a6-98de-0c37768ddb54 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:04.570423 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 291/575] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 13:41:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:04.571163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8fd60-12a6-49a6-98de-0c37768ddb54 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:04.618618 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:04.640264 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f93a9-4cdb-49fe-84f8-ace1a3868ccf None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:04.662050 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:04.679820 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b98556-6b6b-4089-bf5e-9b574ed0c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:04.680555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b98556-6b6b-4089-bf5e-9b574ed0c03a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:04.680841 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b98556-6b6b-4089-bf5e-9b574ed0c03a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:04.681121 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b98556-6b6b-4089-bf5e-9b574ed0c03a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:04.689314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8fd60-12a6-49a6-98de-0c37768ddb54 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:04.692332 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b98556-6b6b-4089-bf5e-9b574ed0c03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:04.693785 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b98556-6b6b-4089-bf5e-9b574ed0c03a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-f6b98556-6b6b-4089-bf5e-9b574ed0c03a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:04.717828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:04.718821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:04.719730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:04.719730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:04.719730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:04.719730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:04.719730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 285/576] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:04.719730 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b98556-6b6b-4089-bf5e-9b574ed0c03a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:04.733486 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9bd62-25ae-4151-98dd-15ced1502cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:04.734164 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9bd62-25ae-4151-98dd-15ced1502cba None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:04.734452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9bd62-25ae-4151-98dd-15ced1502cba None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:04.734732 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9bd62-25ae-4151-98dd-15ced1502cba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:04.735574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9bd62-25ae-4151-98dd-15ced1502cba None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=41c94d4eb019422fbea20bba97fa77a4) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:04.735893 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9bd62-25ae-4151-98dd-15ced1502cba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:04.737416 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9bd62-25ae-4151-98dd-15ced1502cba None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:04.744504 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 292/577] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:04 2022] GET /identity/v3/role_assignments?user.id=41c94d4eb019422fbea20bba97fa77a4&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:04.746410 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff956d2b-37b0-4425-9209-5ae626e854b6 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:04.746795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff956d2b-37b0-4425-9209-5ae626e854b6 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:04.747092 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff956d2b-37b0-4425-9209-5ae626e854b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:04.774012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-ff956d2b-37b0-4425-9209-5ae626e854b6 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:04.775285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-ff956d2b-37b0-4425-9209-5ae626e854b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:04.846008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b98556-6b6b-4089-bf5e-9b574ed0c03a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:04.869353 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 293/578] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:04.876391 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff956d2b-37b0-4425-9209-5ae626e854b6 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:04.899532 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e291e5-9d33-4095-b5bf-abbee162c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:04.900422 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e291e5-9d33-4095-b5bf-abbee162c0a4 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:04.900711 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e291e5-9d33-4095-b5bf-abbee162c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:04.900985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e291e5-9d33-4095-b5bf-abbee162c0a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:04.904158 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:04.913969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e291e5-9d33-4095-b5bf-abbee162c0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:04.915626 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e291e5-9d33-4095-b5bf-abbee162c0a4 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-65e291e5-9d33-4095-b5bf-abbee162c0a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:04.938892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:04.939818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:04.941079 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:04.941079 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:04.941079 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:04.941079 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:04.941079 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 286/579] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:04.941079 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e291e5-9d33-4095-b5bf-abbee162c0a4 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:04.978901 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:05.022047 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff956d2b-37b0-4425-9209-5ae626e854b6 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:05.066774 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e291e5-9d33-4095-b5bf-abbee162c0a4 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:05.068692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea127405-edcb-4411-86f1-bc45abdfbf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:05.069893 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea127405-edcb-4411-86f1-bc45abdfbf68 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:05.070287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea127405-edcb-4411-86f1-bc45abdfbf68 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:05.070564 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea127405-edcb-4411-86f1-bc45abdfbf68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:05.083469 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea127405-edcb-4411-86f1-bc45abdfbf68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:05.084613 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea127405-edcb-4411-86f1-bc45abdfbf68 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-ea127405-edcb-4411-86f1-bc45abdfbf68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:05.107833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:05.108947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:05.114850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:05.114850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:05.114850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:05.114850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:05.115130 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2793d-c314-445d-8938-e3d83e1394a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:05.115130 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2793d-c314-445d-8938-e3d83e1394a9 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:05.115647 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 294/580] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:05.115741 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2793d-c314-445d-8938-e3d83e1394a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:05.115741 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2793d-c314-445d-8938-e3d83e1394a9 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:05.115902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea127405-edcb-4411-86f1-bc45abdfbf68 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:05.115986 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2793d-c314-445d-8938-e3d83e1394a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:05.115986 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2793d-c314-445d-8938-e3d83e1394a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:05.115986 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2793d-c314-445d-8938-e3d83e1394a9 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:05.129348 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 287/581] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:05.130510 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2793d-c314-445d-8938-e3d83e1394a9 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:05.187233 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:05.251170 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea127405-edcb-4411-86f1-bc45abdfbf68 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:05.252250 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2793d-c314-445d-8938-e3d83e1394a9 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:05.279900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:05.295600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af092f-4f4e-43a5-b227-848514a63174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:05.296453 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af092f-4f4e-43a5-b227-848514a63174 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:05.296739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af092f-4f4e-43a5-b227-848514a63174 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:05.296913 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39166d8f-1586-4b9e-bc65-1f82d87d0b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:05.297064 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af092f-4f4e-43a5-b227-848514a63174 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:05.297654 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166d8f-1586-4b9e-bc65-1f82d87d0b41 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:05.298024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166d8f-1586-4b9e-bc65-1f82d87d0b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:05.298306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166d8f-1586-4b9e-bc65-1f82d87d0b41 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:05.299260 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39166d8f-1586-4b9e-bc65-1f82d87d0b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:05.299578 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39166d8f-1586-4b9e-bc65-1f82d87d0b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:05.301354 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39166d8f-1586-4b9e-bc65-1f82d87d0b41 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:05.309488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af092f-4f4e-43a5-b227-848514a63174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:05.319265 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 288/582] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:05.319265 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39166d8f-1586-4b9e-bc65-1f82d87d0b41 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-18af092f-4f4e-43a5-b227-848514a63174 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:05.319534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:05.320435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:05.321295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:05.321295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:05.321295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:05.321295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:05.321295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:05.321295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:05.321295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:05.321295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:05.321295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:05.321295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:05.321295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:05.321295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:05.323374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 295/583] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:05.324329 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af092f-4f4e-43a5-b227-848514a63174 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:05.439808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39166d8f-1586-4b9e-bc65-1f82d87d0b41 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:05.441076 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af092f-4f4e-43a5-b227-848514a63174 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:05.449657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:05.485054 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa94f88-db55-41ee-9df8-b4bca335ed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:05.486034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa94f88-db55-41ee-9df8-b4bca335ed09 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:05.486194 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f20f-bcc2-4805-bda2-f814629b4c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:05.486381 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa94f88-db55-41ee-9df8-b4bca335ed09 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:05.486616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa94f88-db55-41ee-9df8-b4bca335ed09 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:05.486830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f20f-bcc2-4805-bda2-f814629b4c86 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:05.487091 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f20f-bcc2-4805-bda2-f814629b4c86 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:05.487439 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f20f-bcc2-4805-bda2-f814629b4c86 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:05.488290 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8f20f-bcc2-4805-bda2-f814629b4c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:05.488605 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8f20f-bcc2-4805-bda2-f814629b4c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:05.491650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8f20f-bcc2-4805-bda2-f814629b4c86 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:05.500781 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa94f88-db55-41ee-9df8-b4bca335ed09 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:05.502342 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa94f88-db55-41ee-9df8-b4bca335ed09 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:05.504274 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 289/584] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:05.505643 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f20f-bcc2-4805-bda2-f814629b4c86 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-8aa94f88-db55-41ee-9df8-b4bca335ed09 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:05.521144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:05.522314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:05.523390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:05.523390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:05.523390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:05.523390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:05.523390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:05.523390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:05.523390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:05.523390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:05.523390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:41:05.523390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:05.530614 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 296/585] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:41:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:05.531709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa94f88-db55-41ee-9df8-b4bca335ed09 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:05.583643 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:05.631476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f20f-bcc2-4805-bda2-f814629b4c86 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:05.660406 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa94f88-db55-41ee-9df8-b4bca335ed09 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:05.666885 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baeff02-61de-425d-a20c-f76e1924b605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:05.667736 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeff02-61de-425d-a20c-f76e1924b605 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:05.668042 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeff02-61de-425d-a20c-f76e1924b605 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:05.668323 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeff02-61de-425d-a20c-f76e1924b605 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:05.675854 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baeff02-61de-425d-a20c-f76e1924b605 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:05.677406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baeff02-61de-425d-a20c-f76e1924b605 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-1baeff02-61de-425d-a20c-f76e1924b605 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:05.692678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:05.693653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:05.694547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:05.694547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:05.694547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:05.694547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:05.694547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:05.694547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:05.694547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:05.694547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:05.694547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 290/586] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:05.695030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baeff02-61de-425d-a20c-f76e1924b605 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:05.710415 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799338-cea0-4ea3-8d2e-251a79f9bc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:05.711097 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799338-cea0-4ea3-8d2e-251a79f9bc4f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:05.711381 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799338-cea0-4ea3-8d2e-251a79f9bc4f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:05.711657 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799338-cea0-4ea3-8d2e-251a79f9bc4f None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:05.712459 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54799338-cea0-4ea3-8d2e-251a79f9bc4f None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:05.712768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54799338-cea0-4ea3-8d2e-251a79f9bc4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:05.714152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54799338-cea0-4ea3-8d2e-251a79f9bc4f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:05.728175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 297/587] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:05.728368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799338-cea0-4ea3-8d2e-251a79f9bc4f None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:05.745255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:05.842650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baeff02-61de-425d-a20c-f76e1924b605 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:05.848346 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799338-cea0-4ea3-8d2e-251a79f9bc4f None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:05.852574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:05.882464 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f66e23-52d8-4b85-b87f-9ec232955977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:05.883269 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f66e23-52d8-4b85-b87f-9ec232955977 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:05.883549 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f66e23-52d8-4b85-b87f-9ec232955977 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:05.883823 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f66e23-52d8-4b85-b87f-9ec232955977 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:05.891067 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d15d7-5d4b-40f3-9cd9-06154758b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:05.891772 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f66e23-52d8-4b85-b87f-9ec232955977 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:05.892523 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d15d7-5d4b-40f3-9cd9-06154758b72a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:05.893018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d15d7-5d4b-40f3-9cd9-06154758b72a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:05.893380 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f66e23-52d8-4b85-b87f-9ec232955977 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:05.893817 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d15d7-5d4b-40f3-9cd9-06154758b72a None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:05.894980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d15d7-5d4b-40f3-9cd9-06154758b72a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:05.895628 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d15d7-5d4b-40f3-9cd9-06154758b72a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:05.897632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d15d7-5d4b-40f3-9cd9-06154758b72a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-39f66e23-52d8-4b85-b87f-9ec232955977 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:05.908336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:05.909499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:05.910609 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:05.910609 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:05.910609 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:05.910609 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:05.910609 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:05.910609 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:05.910609 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:05.910609 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:05.914346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 291/588] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:05.915335 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f66e23-52d8-4b85-b87f-9ec232955977 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:05.923352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 298/589] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 13:41:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:05.928559 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d15d7-5d4b-40f3-9cd9-06154758b72a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:06.008910 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:06.025599 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f66e23-52d8-4b85-b87f-9ec232955977 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:06.041141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d15d7-5d4b-40f3-9cd9-06154758b72a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:06.061369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48264f-acf1-4e49-ad76-fa2057d2e6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:06.062037 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48264f-acf1-4e49-ad76-fa2057d2e6f8 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:06.062326 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48264f-acf1-4e49-ad76-fa2057d2e6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:06.062611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48264f-acf1-4e49-ad76-fa2057d2e6f8 None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:06.063410 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48264f-acf1-4e49-ad76-fa2057d2e6f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:06.063726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48264f-acf1-4e49-ad76-fa2057d2e6f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:06.065230 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48264f-acf1-4e49-ad76-fa2057d2e6f8 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:06.078032 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 292/590] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:06.078849 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48264f-acf1-4e49-ad76-fa2057d2e6f8 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:06.085452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8655a5-3424-4ffe-a460-b7973ed4532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:06.087292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8655a5-3424-4ffe-a460-b7973ed4532c None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:06.087728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8655a5-3424-4ffe-a460-b7973ed4532c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:06.088176 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8655a5-3424-4ffe-a460-b7973ed4532c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:06.101664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8655a5-3424-4ffe-a460-b7973ed4532c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:06.103312 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8655a5-3424-4ffe-a460-b7973ed4532c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-ec8655a5-3424-4ffe-a460-b7973ed4532c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:06.123457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:06.124592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:06.125519 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:06.125519 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:06.125519 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:06.125519 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:06.125519 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 299/591] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:06.129451 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8655a5-3424-4ffe-a460-b7973ed4532c None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:06.147176 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:06.192895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48264f-acf1-4e49-ad76-fa2057d2e6f8 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:06.229804 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066981f-2c86-4dfe-ba77-161872535678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:06.230583 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066981f-2c86-4dfe-ba77-161872535678 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:06.230857 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066981f-2c86-4dfe-ba77-161872535678 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:06.231129 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066981f-2c86-4dfe-ba77-161872535678 None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:06.232027 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066981f-2c86-4dfe-ba77-161872535678 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:06.232485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066981f-2c86-4dfe-ba77-161872535678 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:06.233912 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066981f-2c86-4dfe-ba77-161872535678 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:06.238253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8655a5-3424-4ffe-a460-b7973ed4532c None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:06.251728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 293/592] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:06.251728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066981f-2c86-4dfe-ba77-161872535678 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:06.258835 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:06.279325 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa99332-32b6-40f0-81de-dd63c507e8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:06.280795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa99332-32b6-40f0-81de-dd63c507e8d4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:06.281080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa99332-32b6-40f0-81de-dd63c507e8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:06.281362 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa99332-32b6-40f0-81de-dd63c507e8d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:06.293278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa99332-32b6-40f0-81de-dd63c507e8d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:06.294828 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa99332-32b6-40f0-81de-dd63c507e8d4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-2aa99332-32b6-40f0-81de-dd63c507e8d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:06.313666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:06.314642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:06.315527 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:06.315527 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:06.315527 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:06.315527 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:06.315527 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 300/593] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:06.315840 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa99332-32b6-40f0-81de-dd63c507e8d4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:06.364992 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066981f-2c86-4dfe-ba77-161872535678 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:06.385027 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:06.401022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9b6b8-6029-4434-9082-92862db0ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:06.402026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9b6b8-6029-4434-9082-92862db0ecf7 None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:06.402368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9b6b8-6029-4434-9082-92862db0ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:06.402656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9b6b8-6029-4434-9082-92862db0ecf7 None admin] PATH_INFO: `/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/62fbf54d04f84afd8dd9270b17207b04/roles/fecd360f4074414fb38da63038e39776` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:06.419135 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9b6b8-6029-4434-9082-92862db0ecf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b57fe974dc4d4542a1dd930fc6912d39, user_id=62fbf54d04f84afd8dd9270b17207b04, role_id=fecd360f4074414fb38da63038e39776)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:06.420628 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9b6b8-6029-4434-9082-92862db0ecf7 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:06.423873 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa99332-32b6-40f0-81de-dd63c507e8d4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:06.435321 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 294/594] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:41:06 2022] PUT /identity/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/62fbf54d04f84afd8dd9270b17207b04/roles/fecd360f4074414fb38da63038e39776 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:41:06.435908 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9b6b8-6029-4434-9082-92862db0ecf7 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:06.484327 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c68ce-8e19-4349-81b5-079787f0cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:06.485015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c68ce-8e19-4349-81b5-079787f0cee9 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:06.485292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c68ce-8e19-4349-81b5-079787f0cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:06.485552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c68ce-8e19-4349-81b5-079787f0cee9 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:06.486295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c68ce-8e19-4349-81b5-079787f0cee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:06.486602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c68ce-8e19-4349-81b5-079787f0cee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:06.488018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c68ce-8e19-4349-81b5-079787f0cee9 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:06.507168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 301/595] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:06.507168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c68ce-8e19-4349-81b5-079787f0cee9 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:06.541019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:06.610433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9b6b8-6029-4434-9082-92862db0ecf7 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:06.648193 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c68ce-8e19-4349-81b5-079787f0cee9 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:06.667126 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f7257-cc53-40c0-8cac-134717475a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:06.668494 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f7257-cc53-40c0-8cac-134717475a9d None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:06.668827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f7257-cc53-40c0-8cac-134717475a9d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:06.669104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f7257-cc53-40c0-8cac-134717475a9d None admin] PATH_INFO: `/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/971eae8a8ad44ce893c311b74acbd76b/roles/fecd360f4074414fb38da63038e39776` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:06.682030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:06.689362 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f7257-cc53-40c0-8cac-134717475a9d None admin] RBAC: Authorizing `identity:create_grant(project_id=b57fe974dc4d4542a1dd930fc6912d39, user_id=971eae8a8ad44ce893c311b74acbd76b, role_id=fecd360f4074414fb38da63038e39776)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:06.690208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96018fc0-fa75-44fe-b3d9-0e796d269628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:06.690886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96018fc0-fa75-44fe-b3d9-0e796d269628 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:06.691141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f7257-cc53-40c0-8cac-134717475a9d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:06.691259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96018fc0-fa75-44fe-b3d9-0e796d269628 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:06.691442 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96018fc0-fa75-44fe-b3d9-0e796d269628 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:06.692206 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96018fc0-fa75-44fe-b3d9-0e796d269628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:06.692521 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96018fc0-fa75-44fe-b3d9-0e796d269628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:06.693956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96018fc0-fa75-44fe-b3d9-0e796d269628 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:06.713577 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 295/596] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:41:06 2022] PUT /identity/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/971eae8a8ad44ce893c311b74acbd76b/roles/fecd360f4074414fb38da63038e39776 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:41:06.714929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f7257-cc53-40c0-8cac-134717475a9d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:06.720540 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 302/597] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:06.728833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96018fc0-fa75-44fe-b3d9-0e796d269628 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:06.860227 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f7257-cc53-40c0-8cac-134717475a9d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:06.870855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:06.911548 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc1779-1cbb-49f7-8777-b32909fefe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:06.912715 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc1779-1cbb-49f7-8777-b32909fefe61 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:06.913145 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc1779-1cbb-49f7-8777-b32909fefe61 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:06.913586 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc1779-1cbb-49f7-8777-b32909fefe61 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:06.924040 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc1779-1cbb-49f7-8777-b32909fefe61 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:06.926040 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc1779-1cbb-49f7-8777-b32909fefe61 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-29bc1779-1cbb-49f7-8777-b32909fefe61 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:06.944076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:06.945285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:06.946421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:06.946421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:06.946421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:06.946421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:06.946421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:06.946421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:06.946421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:06.946421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:06.946421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:41:06.946421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:06.948866 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 296/598] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:06.955958 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc1779-1cbb-49f7-8777-b32909fefe61 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:07.007824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96018fc0-fa75-44fe-b3d9-0e796d269628 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:07.059472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcc1a3-eff4-411c-9b53-33cc611cb070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:07.060462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc1a3-eff4-411c-9b53-33cc611cb070 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:07.061170 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc1a3-eff4-411c-9b53-33cc611cb070 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:07.061550 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc1a3-eff4-411c-9b53-33cc611cb070 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:07.070912 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcc1a3-eff4-411c-9b53-33cc611cb070 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:07.072930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcc1a3-eff4-411c-9b53-33cc611cb070 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-5ebcc1a3-eff4-411c-9b53-33cc611cb070 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:07.093898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:07.094913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:07.095778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:07.095778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:07.095778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:07.095778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:07.095778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:07.095778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:07.095778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:07.095778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:07.096235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 303/599] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:07.097755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761a400-19e9-4c44-9812-ea7e91637765 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:07.098059 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761a400-19e9-4c44-9812-ea7e91637765 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:07.098338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761a400-19e9-4c44-9812-ea7e91637765 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:07.099760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 304/600] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:07.104648 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761a400-19e9-4c44-9812-ea7e91637765 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:07.133583 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc1779-1cbb-49f7-8777-b32909fefe61 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:07.156961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:07.173594 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1aed5-6956-4055-9592-4bad45ed7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:07.174600 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1aed5-6956-4055-9592-4bad45ed7d1f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:07.174946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1aed5-6956-4055-9592-4bad45ed7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:07.175323 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1aed5-6956-4055-9592-4bad45ed7d1f None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:07.176300 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1aed5-6956-4055-9592-4bad45ed7d1f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:07.176727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1aed5-6956-4055-9592-4bad45ed7d1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:07.178353 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1aed5-6956-4055-9592-4bad45ed7d1f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:07.196958 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 297/601] 10.222.0.24 () {56 vars in 1139 bytes} [Wed May 25 13:41:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:07.198362 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030f04c-59c3-48d0-bc4b-302889509e68 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:07.199180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030f04c-59c3-48d0-bc4b-302889509e68 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:07.199572 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030f04c-59c3-48d0-bc4b-302889509e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:07.217161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-f030f04c-59c3-48d0-bc4b-302889509e68 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:07.218474 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-f030f04c-59c3-48d0-bc4b-302889509e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:07.223057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761a400-19e9-4c44-9812-ea7e91637765 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:07.237905 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:07.262119 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e9164-f610-4486-b43d-8a528219d66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:07.263193 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e9164-f610-4486-b43d-8a528219d66c None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:07.263657 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e9164-f610-4486-b43d-8a528219d66c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:07.264187 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e9164-f610-4486-b43d-8a528219d66c None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:07.265187 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e9164-f610-4486-b43d-8a528219d66c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:07.265725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e9164-f610-4486-b43d-8a528219d66c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:07.267483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e9164-f610-4486-b43d-8a528219d66c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:07.282131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 305/602] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:07.283738 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e9164-f610-4486-b43d-8a528219d66c None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:07.316140 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 298/603] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:07.316140 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030f04c-59c3-48d0-bc4b-302889509e68 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:07.422417 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e9164-f610-4486-b43d-8a528219d66c None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:07.428490 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030f04c-59c3-48d0-bc4b-302889509e68 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:07.434211 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:07.473789 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4eac-e7b8-413c-9f76-47d52031b7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:07.474597 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4eac-e7b8-413c-9f76-47d52031b7f7 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:07.474880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4eac-e7b8-413c-9f76-47d52031b7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:07.475158 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4eac-e7b8-413c-9f76-47d52031b7f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:07.475603 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d919052-a68a-41d0-824a-9f816275cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:07.476998 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d919052-a68a-41d0-824a-9f816275cef3 None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:07.477559 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d919052-a68a-41d0-824a-9f816275cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:07.478147 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d919052-a68a-41d0-824a-9f816275cef3 None admin] PATH_INFO: `/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/ac053a5b34cb4fd8a4fb8b0dfa80e922/roles/fecd360f4074414fb38da63038e39776` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:07.486496 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e4eac-e7b8-413c-9f76-47d52031b7f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:07.488206 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e4eac-e7b8-413c-9f76-47d52031b7f7 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:07.497417 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d919052-a68a-41d0-824a-9f816275cef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b57fe974dc4d4542a1dd930fc6912d39, user_id=ac053a5b34cb4fd8a4fb8b0dfa80e922, role_id=fecd360f4074414fb38da63038e39776)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:07.499255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d919052-a68a-41d0-824a-9f816275cef3 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-821e4eac-e7b8-413c-9f76-47d52031b7f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:07.508230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:07.509351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:07.510325 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:07.510325 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:07.510325 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:07.510325 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:07.510325 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 306/604] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:07.511716 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4eac-e7b8-413c-9f76-47d52031b7f7 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:07.520450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 299/605] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:41:07 2022] PUT /identity/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/ac053a5b34cb4fd8a4fb8b0dfa80e922/roles/fecd360f4074414fb38da63038e39776 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:41:07.526402 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d919052-a68a-41d0-824a-9f816275cef3 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:07.535830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:07.635173 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4eac-e7b8-413c-9f76-47d52031b7f7 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:07.674982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e5eeb-554e-4ecc-9b44-c77625f85a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:07.679694 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e5eeb-554e-4ecc-9b44-c77625f85a7a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:07.679694 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e5eeb-554e-4ecc-9b44-c77625f85a7a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:07.679694 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e5eeb-554e-4ecc-9b44-c77625f85a7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:07.696147 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e5eeb-554e-4ecc-9b44-c77625f85a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-951e5eeb-554e-4ecc-9b44-c77625f85a7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:07.697566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:07.698549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:07.699922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 307/606] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:07.712791 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e5eeb-554e-4ecc-9b44-c77625f85a7a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:07.736754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d919052-a68a-41d0-824a-9f816275cef3 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:07.746808 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:07.781388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62509d-d71c-495f-9cc3-c67949abf2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:07.782457 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62509d-d71c-495f-9cc3-c67949abf2e9 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:07.782947 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62509d-d71c-495f-9cc3-c67949abf2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:07.783426 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62509d-d71c-495f-9cc3-c67949abf2e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:07.784433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62509d-d71c-495f-9cc3-c67949abf2e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:07.784975 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62509d-d71c-495f-9cc3-c67949abf2e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:07.786655 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62509d-d71c-495f-9cc3-c67949abf2e9 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:07.801089 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 300/607] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:07.810633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62509d-d71c-495f-9cc3-c67949abf2e9 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:07.885336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:07.921744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e5eeb-554e-4ecc-9b44-c77625f85a7a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:07.934372 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62509d-d71c-495f-9cc3-c67949abf2e9 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:07.960352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a0ec7-bcf3-413b-a048-000a517c87b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:07.961036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a0ec7-bcf3-413b-a048-000a517c87b5 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:07.961320 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a0ec7-bcf3-413b-a048-000a517c87b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:07.961594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a0ec7-bcf3-413b-a048-000a517c87b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:07.962348 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a0ec7-bcf3-413b-a048-000a517c87b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:07.962657 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a0ec7-bcf3-413b-a048-000a517c87b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:07.964096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a0ec7-bcf3-413b-a048-000a517c87b5 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:07.973908 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 308/608] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:07.976840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cae547-32da-410a-be92-216634310a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:07.977887 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cae547-32da-410a-be92-216634310a6a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:07.978380 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cae547-32da-410a-be92-216634310a6a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:07.978890 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cae547-32da-410a-be92-216634310a6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:07.980601 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a0ec7-bcf3-413b-a048-000a517c87b5 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:07.989103 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cae547-32da-410a-be92-216634310a6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:07.991494 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cae547-32da-410a-be92-216634310a6a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-e1cae547-32da-410a-be92-216634310a6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:08.012318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:08.013389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:08.014272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:08.014272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:08.014272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:08.014272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:08.014272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:08.014272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:08.014272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:08.014272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:08.014272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 301/609] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:08.019049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cae547-32da-410a-be92-216634310a6a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:08.089133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:08.115783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a0ec7-bcf3-413b-a048-000a517c87b5 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:08.154977 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108f121-920e-4131-9949-dd85846d7694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:08.156302 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108f121-920e-4131-9949-dd85846d7694 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:08.156831 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108f121-920e-4131-9949-dd85846d7694 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:08.157318 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108f121-920e-4131-9949-dd85846d7694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:08.170673 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108f121-920e-4131-9949-dd85846d7694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:08.172619 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108f121-920e-4131-9949-dd85846d7694 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-d108f121-920e-4131-9949-dd85846d7694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:08.195706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:08.196675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:08.197572 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:08.197572 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:08.197572 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:08.197572 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:08.200677 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 309/610] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:08.212291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108f121-920e-4131-9949-dd85846d7694 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:08.242923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cae547-32da-410a-be92-216634310a6a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:08.288135 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:08.311256 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6614b-988b-4fb4-b119-624f9b2f3924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:08.311939 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6614b-988b-4fb4-b119-624f9b2f3924 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:08.312251 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6614b-988b-4fb4-b119-624f9b2f3924 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:08.312530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6614b-988b-4fb4-b119-624f9b2f3924 None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:08.313346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6614b-988b-4fb4-b119-624f9b2f3924 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:08.313659 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6614b-988b-4fb4-b119-624f9b2f3924 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:08.315103 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6614b-988b-4fb4-b119-624f9b2f3924 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:08.337227 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 302/611] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:08.345566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6614b-988b-4fb4-b119-624f9b2f3924 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:08.427491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108f121-920e-4131-9949-dd85846d7694 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:08.491662 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:08.501265 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc0e7f-83a3-4190-bf4a-5104d3e69ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:08.501934 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc0e7f-83a3-4190-bf4a-5104d3e69ad5 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:08.502214 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc0e7f-83a3-4190-bf4a-5104d3e69ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:08.502487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc0e7f-83a3-4190-bf4a-5104d3e69ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:08.503215 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc0e7f-83a3-4190-bf4a-5104d3e69ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:08.503521 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc0e7f-83a3-4190-bf4a-5104d3e69ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:08.504938 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc0e7f-83a3-4190-bf4a-5104d3e69ad5 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:08.529518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 310/612] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:08.535643 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc0e7f-83a3-4190-bf4a-5104d3e69ad5 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:08.547642 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6614b-988b-4fb4-b119-624f9b2f3924 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:08.619893 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e8b31-6d22-42a4-bfbc-e0f1a128f682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:08.621394 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e8b31-6d22-42a4-bfbc-e0f1a128f682 None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:08.621674 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e8b31-6d22-42a4-bfbc-e0f1a128f682 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:08.621953 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e8b31-6d22-42a4-bfbc-e0f1a128f682 None admin] PATH_INFO: `/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/e29f2382dd6f4f648c31f12240ba5793/roles/fecd360f4074414fb38da63038e39776` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:08.651709 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e8b31-6d22-42a4-bfbc-e0f1a128f682 None admin] RBAC: Authorizing `identity:create_grant(project_id=b57fe974dc4d4542a1dd930fc6912d39, user_id=e29f2382dd6f4f648c31f12240ba5793, role_id=fecd360f4074414fb38da63038e39776)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:08.655774 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e8b31-6d22-42a4-bfbc-e0f1a128f682 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:08.678950 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 303/613] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:41:08 2022] PUT /identity/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/e29f2382dd6f4f648c31f12240ba5793/roles/fecd360f4074414fb38da63038e39776 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:41:08.721924 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc0e7f-83a3-4190-bf4a-5104d3e69ad5 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:08.767564 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8d260-23ac-460b-b6df-d304517c63b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:08.768380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8d260-23ac-460b-b6df-d304517c63b6 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:08.768662 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8d260-23ac-460b-b6df-d304517c63b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:08.768936 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8d260-23ac-460b-b6df-d304517c63b6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:08.778940 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8d260-23ac-460b-b6df-d304517c63b6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:08.780545 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8d260-23ac-460b-b6df-d304517c63b6 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-a5e8d260-23ac-460b-b6df-d304517c63b6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:08.797168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:08.799472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:08.800809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:08.800809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:08.800809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:08.800809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:08.800809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:08.800809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:08.800809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:08.800809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:08.800809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:41:08.800809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:08.800809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 311/614] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:41:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:08.804284 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e8b31-6d22-42a4-bfbc-e0f1a128f682 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:08.845176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:08.948424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e8b31-6d22-42a4-bfbc-e0f1a128f682 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:08.994348 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceef724-4c13-4bdc-b688-8156f954dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:08.995750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceef724-4c13-4bdc-b688-8156f954dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:08.996252 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceef724-4c13-4bdc-b688-8156f954dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:08.996884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceef724-4c13-4bdc-b688-8156f954dfb2 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:08.997962 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceef724-4c13-4bdc-b688-8156f954dfb2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:08.998398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceef724-4c13-4bdc-b688-8156f954dfb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:09.000217 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceef724-4c13-4bdc-b688-8156f954dfb2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:09.027551 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 304/615] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 13:41:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:09.033226 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8d260-23ac-460b-b6df-d304517c63b6 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:09.141038 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:09.187205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70453c0e-67b3-49b6-8f49-3dc85835b8d5 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:09.187556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70453c0e-67b3-49b6-8f49-3dc85835b8d5 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:09.188009 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70453c0e-67b3-49b6-8f49-3dc85835b8d5 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:09.189278 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 305/616] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:41:09.195939 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9189da-329e-4585-87e5-9e84bee18956 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:09.196348 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9189da-329e-4585-87e5-9e84bee18956 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:09.196547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9189da-329e-4585-87e5-9e84bee18956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:09.211458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8d260-23ac-460b-b6df-d304517c63b6 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:09.245207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-ff9189da-329e-4585-87e5-9e84bee18956 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:09.246521 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-ff9189da-329e-4585-87e5-9e84bee18956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:09.251121 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577a318-f515-4c41-8b3b-8232782062d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:09.251925 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577a318-f515-4c41-8b3b-8232782062d7 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:09.252242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577a318-f515-4c41-8b3b-8232782062d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:09.252522 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577a318-f515-4c41-8b3b-8232782062d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:09.265072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577a318-f515-4c41-8b3b-8232782062d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:09.266972 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577a318-f515-4c41-8b3b-8232782062d7 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-6577a318-f515-4c41-8b3b-8232782062d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:09.288366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:09.289365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:09.290251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:09.290251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:09.290251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:09.290251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:09.290251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 312/617] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:09.298417 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577a318-f515-4c41-8b3b-8232782062d7 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:09.393779 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 306/618] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:41:09.414788 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577a318-f515-4c41-8b3b-8232782062d7 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:09.417952 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:09.418302 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9189da-329e-4585-87e5-9e84bee18956 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:09.452706 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:09.497330 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92d309-ef6c-4f0b-b923-8136ceec0214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:09.498046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92d309-ef6c-4f0b-b923-8136ceec0214 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:09.498299 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92d309-ef6c-4f0b-b923-8136ceec0214 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:09.498580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92d309-ef6c-4f0b-b923-8136ceec0214 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:09.499316 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92d309-ef6c-4f0b-b923-8136ceec0214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:09.499622 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92d309-ef6c-4f0b-b923-8136ceec0214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:09.501041 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92d309-ef6c-4f0b-b923-8136ceec0214 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:09.528235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 313/619] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:09.533198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9189da-329e-4585-87e5-9e84bee18956 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:09.544238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92d309-ef6c-4f0b-b923-8136ceec0214 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:09.596979 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e49ba-9601-4404-9c56-1c54f871deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:09.598481 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e49ba-9601-4404-9c56-1c54f871deae None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:09.598970 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e49ba-9601-4404-9c56-1c54f871deae None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:09.599499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e49ba-9601-4404-9c56-1c54f871deae None admin] PATH_INFO: `/v3/roles/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:09.620030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e49ba-9601-4404-9c56-1c54f871deae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-0c4e49ba-9601-4404-9c56-1c54f871deae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:09.630067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:09.631049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:09.631895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 307/620] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:09.637097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22737773-1acc-48aa-ae1b-6c36a35046f5 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:09.637388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22737773-1acc-48aa-ae1b-6c36a35046f5 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:09.637667 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22737773-1acc-48aa-ae1b-6c36a35046f5 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:09.639160 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 308/621] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:09.640194 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22737773-1acc-48aa-ae1b-6c36a35046f5 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:09.704874 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92d309-ef6c-4f0b-b923-8136ceec0214 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:09.734842 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:09.748374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae88a7b-16f9-4fd3-8b0d-f9d64a3ea385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:09.749615 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae88a7b-16f9-4fd3-8b0d-f9d64a3ea385 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:09.750115 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae88a7b-16f9-4fd3-8b0d-f9d64a3ea385 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:09.750663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae88a7b-16f9-4fd3-8b0d-f9d64a3ea385 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:09.755964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22737773-1acc-48aa-ae1b-6c36a35046f5 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:09.759625 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae88a7b-16f9-4fd3-8b0d-f9d64a3ea385 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:09.761547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae88a7b-16f9-4fd3-8b0d-f9d64a3ea385 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-bae88a7b-16f9-4fd3-8b0d-f9d64a3ea385 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:09.781634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:09.782594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:09.783503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:09.783503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:09.783503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:09.783503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:09.783503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:09.783503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:09.783503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:09.783503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:09.785947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 314/622] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:09.787502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d450-e1b1-4b69-b95a-c522739b2418 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:09.788002 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d450-e1b1-4b69-b95a-c522739b2418 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:09.788509 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d450-e1b1-4b69-b95a-c522739b2418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:09.793332 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97b8f1-ece2-4425-8bc7-76e79d2e0360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:09.794089 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97b8f1-ece2-4425-8bc7-76e79d2e0360 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:09.794433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97b8f1-ece2-4425-8bc7-76e79d2e0360 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:09.794659 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97b8f1-ece2-4425-8bc7-76e79d2e0360 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:09.795432 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97b8f1-ece2-4425-8bc7-76e79d2e0360 None admin] RBAC: Adding query filter params (name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:09.795745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97b8f1-ece2-4425-8bc7-76e79d2e0360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:09.797324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97b8f1-ece2-4425-8bc7-76e79d2e0360 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:09.811003 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 309/623] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:09.811003 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97b8f1-ece2-4425-8bc7-76e79d2e0360 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:09.812754 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-5e73d450-e1b1-4b69-b95a-c522739b2418 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:09.814355 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-5e73d450-e1b1-4b69-b95a-c522739b2418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:09.836749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:09.892751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 315/624] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:09.893950 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d450-e1b1-4b69-b95a-c522739b2418 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:09.927602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97b8f1-ece2-4425-8bc7-76e79d2e0360 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:09.966176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e6073-0c9d-4c1c-86cb-a6674977337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:09.966847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e6073-0c9d-4c1c-86cb-a6674977337a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:09.967136 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e6073-0c9d-4c1c-86cb-a6674977337a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:09.967419 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e6073-0c9d-4c1c-86cb-a6674977337a None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:09.968285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e6073-0c9d-4c1c-86cb-a6674977337a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:09.968603 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e6073-0c9d-4c1c-86cb-a6674977337a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:09.970674 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e6073-0c9d-4c1c-86cb-a6674977337a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:09.985672 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 310/625] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:09.986569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e6073-0c9d-4c1c-86cb-a6674977337a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:09.996625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:10.011708 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d450-e1b1-4b69-b95a-c522739b2418 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:10.050136 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b810f-db32-4657-bffe-fecaeb70cf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:10.051360 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b810f-db32-4657-bffe-fecaeb70cf7b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:10.051966 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b810f-db32-4657-bffe-fecaeb70cf7b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:10.052521 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b810f-db32-4657-bffe-fecaeb70cf7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:10.063757 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b810f-db32-4657-bffe-fecaeb70cf7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:10.065657 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b810f-db32-4657-bffe-fecaeb70cf7b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-820b810f-db32-4657-bffe-fecaeb70cf7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:10.084637 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:10.085600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:10.086498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:10.086498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:10.086498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:10.086498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:10.093669 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 316/626] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:10.095005 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b810f-db32-4657-bffe-fecaeb70cf7b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:10.105232 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:10.107132 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e6073-0c9d-4c1c-86cb-a6674977337a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:10.147604 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca3072-8878-4190-9b6e-b34a2a2c18df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:10.148823 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3072-8878-4190-9b6e-b34a2a2c18df None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:10.149293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3072-8878-4190-9b6e-b34a2a2c18df None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:10.149719 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3072-8878-4190-9b6e-b34a2a2c18df None admin] PATH_INFO: `/v3/roles/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:10.162194 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca3072-8878-4190-9b6e-b34a2a2c18df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-c9ca3072-8878-4190-9b6e-b34a2a2c18df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:10.171223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:10.172450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:10.173293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:10.173293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:10.173293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:10.173293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:10.173293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:10.173293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:10.173293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:10.173293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:10.173293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:10.173293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:10.173293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:10.173293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:10.176052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 311/627] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:10.177214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca3072-8878-4190-9b6e-b34a2a2c18df None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:10.216618 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b810f-db32-4657-bffe-fecaeb70cf7b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:10.254292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e623bd8-f9a3-4060-893a-a3274382bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:10.255288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e623bd8-f9a3-4060-893a-a3274382bf83 None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:10.255677 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e623bd8-f9a3-4060-893a-a3274382bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:10.255977 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e623bd8-f9a3-4060-893a-a3274382bf83 None admin] PATH_INFO: `/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/41c94d4eb019422fbea20bba97fa77a4/roles/fecd360f4074414fb38da63038e39776` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:10.271661 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e623bd8-f9a3-4060-893a-a3274382bf83 None admin] RBAC: Authorizing `identity:create_grant(project_id=b57fe974dc4d4542a1dd930fc6912d39, user_id=41c94d4eb019422fbea20bba97fa77a4, role_id=fecd360f4074414fb38da63038e39776)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:10.273283 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e623bd8-f9a3-4060-893a-a3274382bf83 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:10.281043 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:10.295292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 317/628] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:41:10 2022] PUT /identity/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/41c94d4eb019422fbea20bba97fa77a4/roles/fecd360f4074414fb38da63038e39776 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:41:10.295292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e623bd8-f9a3-4060-893a-a3274382bf83 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:10.318977 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca3072-8878-4190-9b6e-b34a2a2c18df None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:10.367249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:10.393591 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43968b-636e-4ede-9df6-5838a9cafe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:10.394268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43968b-636e-4ede-9df6-5838a9cafe22 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:10.394548 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43968b-636e-4ede-9df6-5838a9cafe22 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:10.394821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43968b-636e-4ede-9df6-5838a9cafe22 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:10.395563 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43968b-636e-4ede-9df6-5838a9cafe22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:10.395880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43968b-636e-4ede-9df6-5838a9cafe22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:10.397338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43968b-636e-4ede-9df6-5838a9cafe22 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:10.413973 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 312/629] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:10.415397 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c0cb0-8ca7-478f-b5af-5bb3398f311d None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:10.415633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c0cb0-8ca7-478f-b5af-5bb3398f311d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:10.415906 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c0cb0-8ca7-478f-b5af-5bb3398f311d None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:10.422179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 313/630] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:10.423621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f756b-98c8-4bbb-bdda-7bf69752abab None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:10.423911 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f756b-98c8-4bbb-bdda-7bf69752abab None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:10.424229 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f756b-98c8-4bbb-bdda-7bf69752abab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:10.441782 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e623bd8-f9a3-4060-893a-a3274382bf83 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:10.441982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-e16f756b-98c8-4bbb-bdda-7bf69752abab None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:10.443015 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-e16f756b-98c8-4bbb-bdda-7bf69752abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:10.495602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92c740-9c20-4d84-a5da-54279a813014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:10.496748 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92c740-9c20-4d84-a5da-54279a813014 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:10.497035 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92c740-9c20-4d84-a5da-54279a813014 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:10.497309 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92c740-9c20-4d84-a5da-54279a813014 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:10.498114 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92c740-9c20-4d84-a5da-54279a813014 None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:10.498650 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92c740-9c20-4d84-a5da-54279a813014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:10.499785 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92c740-9c20-4d84-a5da-54279a813014 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:10.509907 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 318/631] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:10.511511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92c740-9c20-4d84-a5da-54279a813014 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:10.529637 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 314/632] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:10.531459 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f756b-98c8-4bbb-bdda-7bf69752abab None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:10.608587 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:10.644389 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92c740-9c20-4d84-a5da-54279a813014 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:10.663061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:10.667193 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f756b-98c8-4bbb-bdda-7bf69752abab None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:10.687149 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5fb78-3111-4f06-ab6e-0c7ce4004770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:10.688532 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5fb78-3111-4f06-ab6e-0c7ce4004770 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:10.688975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5fb78-3111-4f06-ab6e-0c7ce4004770 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:10.689399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5fb78-3111-4f06-ab6e-0c7ce4004770 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:10.701234 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5fb78-3111-4f06-ab6e-0c7ce4004770 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:10.703664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5fb78-3111-4f06-ab6e-0c7ce4004770 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:10.705930 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebeb27-8923-4a92-a73a-73232039b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:10.706852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebeb27-8923-4a92-a73a-73232039b691 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:10.707142 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebeb27-8923-4a92-a73a-73232039b691 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:10.707420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebeb27-8923-4a92-a73a-73232039b691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-cea5fb78-3111-4f06-ab6e-0c7ce4004770 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:10.722010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:10.723028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:10.723953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:10.723953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:10.723953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:10.723953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:10.723953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:10.723953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:10.723953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:10.723953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:10.723953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 13:41:10.723953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:10.725793 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 319/633] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:41:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:10.730603 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5fb78-3111-4f06-ab6e-0c7ce4004770 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:10.730806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebeb27-8923-4a92-a73a-73232039b691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:10.730806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebeb27-8923-4a92-a73a-73232039b691 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-52ebeb27-8923-4a92-a73a-73232039b691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:10.755066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:10.756024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:10.756966 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:10.756966 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:10.756966 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:10.756966 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:10.759725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 315/634] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:10.761413 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebeb27-8923-4a92-a73a-73232039b691 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:10.858008 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5fb78-3111-4f06-ab6e-0c7ce4004770 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:10.883971 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebeb27-8923-4a92-a73a-73232039b691 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:10.892953 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:10.897470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c42b0c-c622-46f1-b645-579f3e0fdc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:10.898454 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c42b0c-c622-46f1-b645-579f3e0fdc3a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:10.898948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c42b0c-c622-46f1-b645-579f3e0fdc3a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:10.899344 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c42b0c-c622-46f1-b645-579f3e0fdc3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:10.912433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c42b0c-c622-46f1-b645-579f3e0fdc3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-82c42b0c-c622-46f1-b645-579f3e0fdc3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:10.921537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:10.922692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:10.923558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:10.923558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:10.923558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:10.923558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:10.923558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:10.923558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:10.923558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:10.923558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:10.923558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:10.923558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:10.923558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:10.923558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:10.924245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 320/635] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:10.925264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c42b0c-c622-46f1-b645-579f3e0fdc3a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:10.927138 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10207-33cd-4660-8bd1-4e8332e25e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:10.927996 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10207-33cd-4660-8bd1-4e8332e25e0f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:10.928712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10207-33cd-4660-8bd1-4e8332e25e0f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:10.929137 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10207-33cd-4660-8bd1-4e8332e25e0f None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:10.930201 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e10207-33cd-4660-8bd1-4e8332e25e0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:10.930687 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e10207-33cd-4660-8bd1-4e8332e25e0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:10.932343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e10207-33cd-4660-8bd1-4e8332e25e0f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:10.956050 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 316/636] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 13:41:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:10.957313 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10207-33cd-4660-8bd1-4e8332e25e0f None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:10.977875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:11.049840 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c42b0c-c622-46f1-b645-579f3e0fdc3a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:11.088675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb23a6-02fe-4fff-b2da-0211424ffaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:11.089892 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb23a6-02fe-4fff-b2da-0211424ffaea None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:11.090364 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb23a6-02fe-4fff-b2da-0211424ffaea None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:11.090857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb23a6-02fe-4fff-b2da-0211424ffaea None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:11.091389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10207-33cd-4660-8bd1-4e8332e25e0f None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:11.091975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb23a6-02fe-4fff-b2da-0211424ffaea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:11.092481 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb23a6-02fe-4fff-b2da-0211424ffaea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:11.094076 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb23a6-02fe-4fff-b2da-0211424ffaea None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:11.108451 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 321/637] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:11.109673 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb23a6-02fe-4fff-b2da-0211424ffaea None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:11.142572 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a536da5-c49d-41db-b432-f48fffc8e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:11.143166 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a536da5-c49d-41db-b432-f48fffc8e5cf None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:11.143448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a536da5-c49d-41db-b432-f48fffc8e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:11.143728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a536da5-c49d-41db-b432-f48fffc8e5cf None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:11.144581 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a536da5-c49d-41db-b432-f48fffc8e5cf None admin] RBAC: Adding query filter params (name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:11.144890 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a536da5-c49d-41db-b432-f48fffc8e5cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:11.146350 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a536da5-c49d-41db-b432-f48fffc8e5cf None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:11.157160 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 317/638] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:11.158132 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a536da5-c49d-41db-b432-f48fffc8e5cf None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:11.192790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:11.223588 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:11.229699 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb23a6-02fe-4fff-b2da-0211424ffaea None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:11.267310 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c7c7c-feb5-4534-abfe-d5a248b45547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:11.268390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c7c7c-feb5-4534-abfe-d5a248b45547 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:11.268980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c7c7c-feb5-4534-abfe-d5a248b45547 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:11.269458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c7c7c-feb5-4534-abfe-d5a248b45547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:11.277921 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a536da5-c49d-41db-b432-f48fffc8e5cf None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:11.316990 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842f771-c1db-455e-beab-8253bf747ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:11.317963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842f771-c1db-455e-beab-8253bf747ba7 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:11.318255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842f771-c1db-455e-beab-8253bf747ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:11.318552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842f771-c1db-455e-beab-8253bf747ba7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:11.328634 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842f771-c1db-455e-beab-8253bf747ba7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:11.330179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842f771-c1db-455e-beab-8253bf747ba7 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-3842f771-c1db-455e-beab-8253bf747ba7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:11.347411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:11.348488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:11.349436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:11.349436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:11.349436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:11.349436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:11.349436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:11.349436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:11.349436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:11.349436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:11.349436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:41:11.349436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:11.352438 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 318/639] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 13:41:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:11.353544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842f771-c1db-455e-beab-8253bf747ba7 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:11.355932 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c7c7c-feb5-4534-abfe-d5a248b45547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:11.357730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c7c7c-feb5-4534-abfe-d5a248b45547 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:11.478966 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:11.484564 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:11.494094 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 322/640] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:41:11.495143 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c7c7c-feb5-4534-abfe-d5a248b45547 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:11.502184 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842f771-c1db-455e-beab-8253bf747ba7 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:11.548855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b2177-727b-4373-b32a-9f5ff453926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:11.549663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b2177-727b-4373-b32a-9f5ff453926c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:11.550352 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b2177-727b-4373-b32a-9f5ff453926c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:11.550653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b2177-727b-4373-b32a-9f5ff453926c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:11.563275 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b2177-727b-4373-b32a-9f5ff453926c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:11.564797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b2177-727b-4373-b32a-9f5ff453926c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-5f3b2177-727b-4373-b32a-9f5ff453926c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:11.585462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:11.586653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:11.587754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:11.587754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:11.587754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:11.587754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:11.587754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 319/641] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:11.587754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed471e-9226-4a4f-a97b-0367fe3dd54b None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:11.587754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed471e-9226-4a4f-a97b-0367fe3dd54b None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:11.587754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed471e-9226-4a4f-a97b-0367fe3dd54b None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:11.592172 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 320/642] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:11.592172 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed471e-9226-4a4f-a97b-0367fe3dd54b None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:11.626589 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c7c7c-feb5-4534-abfe-d5a248b45547 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:11.666413 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02eecd-d2f0-444d-a3b0-d26d04e080dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:11.667254 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02eecd-d2f0-444d-a3b0-d26d04e080dd None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:11.667567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02eecd-d2f0-444d-a3b0-d26d04e080dd None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:11.667971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02eecd-d2f0-444d-a3b0-d26d04e080dd None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:11.668894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02eecd-d2f0-444d-a3b0-d26d04e080dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:11.669216 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02eecd-d2f0-444d-a3b0-d26d04e080dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:11.670765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02eecd-d2f0-444d-a3b0-d26d04e080dd None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:11.690857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 323/643] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 13:41:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:11.691731 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02eecd-d2f0-444d-a3b0-d26d04e080dd None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:11.716498 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed471e-9226-4a4f-a97b-0367fe3dd54b None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:11.759202 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f9074-2b39-4a9f-9438-da157d430a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:11.759406 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:11.759913 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9074-2b39-4a9f-9438-da157d430a28 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:11.760225 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9074-2b39-4a9f-9438-da157d430a28 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:11.760502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9074-2b39-4a9f-9438-da157d430a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:11.770492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:11.773592 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f9074-2b39-4a9f-9438-da157d430a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:11.775096 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f9074-2b39-4a9f-9438-da157d430a28 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-c81f9074-2b39-4a9f-9438-da157d430a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:11.794204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:11.795344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:11.796744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:11.796744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:11.796744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:11.796744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:11.796744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 321/644] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:11.796744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f301a-b057-458d-8d5c-699a447ea25a None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:11.797104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f301a-b057-458d-8d5c-699a447ea25a None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:11.797174 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f301a-b057-458d-8d5c-699a447ea25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:11.813569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-196f301a-b057-458d-8d5c-699a447ea25a None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:11.814778 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-196f301a-b057-458d-8d5c-699a447ea25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:11.817004 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02eecd-d2f0-444d-a3b0-d26d04e080dd None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:11.857246 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227f48b-93ee-4bd9-9e11-96674405832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:11.857962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227f48b-93ee-4bd9-9e11-96674405832d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:11.858246 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227f48b-93ee-4bd9-9e11-96674405832d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:11.858563 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227f48b-93ee-4bd9-9e11-96674405832d None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:11.859296 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227f48b-93ee-4bd9-9e11-96674405832d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:11.859648 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227f48b-93ee-4bd9-9e11-96674405832d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:11.861087 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227f48b-93ee-4bd9-9e11-96674405832d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:11.872821 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 324/645] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:11.873657 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227f48b-93ee-4bd9-9e11-96674405832d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:11.890880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 322/646] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:11.891734 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f301a-b057-458d-8d5c-699a447ea25a None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:11.997853 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227f48b-93ee-4bd9-9e11-96674405832d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:12.003386 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f301a-b057-458d-8d5c-699a447ea25a None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:12.017261 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:12.026854 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:12.039522 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c83b8f-4575-49c0-b778-bbaae19c8909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:12.040208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c83b8f-4575-49c0-b778-bbaae19c8909 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:12.040497 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c83b8f-4575-49c0-b778-bbaae19c8909 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:12.040775 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c83b8f-4575-49c0-b778-bbaae19c8909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:12.041561 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86562f2d-784c-4f5a-9aae-6505005d1985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:12.042597 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86562f2d-784c-4f5a-9aae-6505005d1985 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:12.042879 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86562f2d-784c-4f5a-9aae-6505005d1985 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:12.043317 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86562f2d-784c-4f5a-9aae-6505005d1985 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:12.043884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86562f2d-784c-4f5a-9aae-6505005d1985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:12.044232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86562f2d-784c-4f5a-9aae-6505005d1985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:12.045616 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86562f2d-784c-4f5a-9aae-6505005d1985 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:12.058068 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 323/647] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:12.059021 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86562f2d-784c-4f5a-9aae-6505005d1985 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:12.128094 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c83b8f-4575-49c0-b778-bbaae19c8909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:12.129858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c83b8f-4575-49c0-b778-bbaae19c8909 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:12.176831 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86562f2d-784c-4f5a-9aae-6505005d1985 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:12.211869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8651c1-66eb-4fb5-9c4c-f0c0d0a7f420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:12.212711 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8651c1-66eb-4fb5-9c4c-f0c0d0a7f420 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:12.212996 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8651c1-66eb-4fb5-9c4c-f0c0d0a7f420 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:12.213275 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8651c1-66eb-4fb5-9c4c-f0c0d0a7f420 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:12.222316 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8651c1-66eb-4fb5-9c4c-f0c0d0a7f420 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:12.223788 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8651c1-66eb-4fb5-9c4c-f0c0d0a7f420 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-dc8651c1-66eb-4fb5-9c4c-f0c0d0a7f420 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:12.243403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:12.244478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:12.245663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:12.245663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:12.245663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:12.245663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:12.245663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:12.245663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:12.245663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:12.245663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:12.245663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:41:12.245663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:12.245663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 324/648] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:41:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:12.246272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8651c1-66eb-4fb5-9c4c-f0c0d0a7f420 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:12.248636 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 325/649] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:41:12.249811 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c83b8f-4575-49c0-b778-bbaae19c8909 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:12.271622 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:12.295725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:12.360881 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8651c1-66eb-4fb5-9c4c-f0c0d0a7f420 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:12.373238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c83b8f-4575-49c0-b778-bbaae19c8909 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:12.403326 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc8c33-50f5-4a1c-addb-1d6822b20ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:12.404304 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc8c33-50f5-4a1c-addb-1d6822b20ca2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:12.404489 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc8c33-50f5-4a1c-addb-1d6822b20ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:12.404737 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc8c33-50f5-4a1c-addb-1d6822b20ca2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:12.414943 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db28ea-25f6-4b68-b3d3-b9c16520ccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:12.416221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db28ea-25f6-4b68-b3d3-b9c16520ccf9 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:12.416329 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc8c33-50f5-4a1c-addb-1d6822b20ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:12.416569 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db28ea-25f6-4b68-b3d3-b9c16520ccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:12.417036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db28ea-25f6-4b68-b3d3-b9c16520ccf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-8ffc8c33-50f5-4a1c-addb-1d6822b20ca2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:12.424446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:12.425424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:12.426268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 325/650] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:12.426952 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc8c33-50f5-4a1c-addb-1d6822b20ca2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:12.429257 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db28ea-25f6-4b68-b3d3-b9c16520ccf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:12.431429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db28ea-25f6-4b68-b3d3-b9c16520ccf9 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-79db28ea-25f6-4b68-b3d3-b9c16520ccf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:12.452962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:12.453967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:12.454872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:12.454872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:12.454872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:12.454872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:12.454872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:12.454872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:12.454872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:12.454872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:12.455312 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 326/651] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:12.456021 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db28ea-25f6-4b68-b3d3-b9c16520ccf9 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:12.544216 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:12.547748 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc8c33-50f5-4a1c-addb-1d6822b20ca2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:12.549055 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:12.574591 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db28ea-25f6-4b68-b3d3-b9c16520ccf9 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:12.587043 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497e55c-6eac-472e-80b6-06b385a7bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:12.588234 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e55c-6eac-472e-80b6-06b385a7bf5f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:12.589414 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e55c-6eac-472e-80b6-06b385a7bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:12.589808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e55c-6eac-472e-80b6-06b385a7bf5f None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:12.590673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497e55c-6eac-472e-80b6-06b385a7bf5f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:12.590985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497e55c-6eac-472e-80b6-06b385a7bf5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:12.592767 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497e55c-6eac-472e-80b6-06b385a7bf5f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:12.610986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0ec42-39bf-4b98-b0a0-891402df6d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:12.611798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0ec42-39bf-4b98-b0a0-891402df6d19 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:12.612083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0ec42-39bf-4b98-b0a0-891402df6d19 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:12.616714 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0ec42-39bf-4b98-b0a0-891402df6d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:12.616885 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 326/652] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 13:41:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:12.616885 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497e55c-6eac-472e-80b6-06b385a7bf5f None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:12.628439 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0ec42-39bf-4b98-b0a0-891402df6d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:12.629934 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0ec42-39bf-4b98-b0a0-891402df6d19 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-e2f0ec42-39bf-4b98-b0a0-891402df6d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:12.649730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:12.650767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:12.652686 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:12.652686 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:12.652686 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:12.652686 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:12.652686 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 327/653] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:12.652686 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0ec42-39bf-4b98-b0a0-891402df6d19 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:12.785087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497e55c-6eac-472e-80b6-06b385a7bf5f None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:12.802279 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0ec42-39bf-4b98-b0a0-891402df6d19 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:12.833754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15da597-e8c9-47d9-b8e6-73d88f8973c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:12.834155 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:12.835163 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15da597-e8c9-47d9-b8e6-73d88f8973c0 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:12.835557 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15da597-e8c9-47d9-b8e6-73d88f8973c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:12.835713 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15da597-e8c9-47d9-b8e6-73d88f8973c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:12.836504 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15da597-e8c9-47d9-b8e6-73d88f8973c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:12.836866 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15da597-e8c9-47d9-b8e6-73d88f8973c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:12.838192 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15da597-e8c9-47d9-b8e6-73d88f8973c0 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:12.845261 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95120883-9b14-478c-aca1-674ab16e715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:12.845942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95120883-9b14-478c-aca1-674ab16e715d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:12.846229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95120883-9b14-478c-aca1-674ab16e715d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:12.846509 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95120883-9b14-478c-aca1-674ab16e715d None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:12.847313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95120883-9b14-478c-aca1-674ab16e715d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:12.847692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95120883-9b14-478c-aca1-674ab16e715d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:12.849231 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95120883-9b14-478c-aca1-674ab16e715d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:12.852856 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 327/654] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:12.853795 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15da597-e8c9-47d9-b8e6-73d88f8973c0 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:12.863352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 328/655] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:12.863352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95120883-9b14-478c-aca1-674ab16e715d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:12.883854 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:13.000074 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95120883-9b14-478c-aca1-674ab16e715d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:13.000707 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15da597-e8c9-47d9-b8e6-73d88f8973c0 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:13.039285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553c55-672c-4bab-b0cf-067af9e0db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:13.039526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025744a-b727-41f6-823f-011b550923df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:13.039952 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553c55-672c-4bab-b0cf-067af9e0db4c None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:13.040096 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025744a-b727-41f6-823f-011b550923df None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:13.040270 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553c55-672c-4bab-b0cf-067af9e0db4c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:13.040380 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025744a-b727-41f6-823f-011b550923df None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:13.040546 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553c55-672c-4bab-b0cf-067af9e0db4c None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:13.040637 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025744a-b727-41f6-823f-011b550923df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:13.041272 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553c55-672c-4bab-b0cf-067af9e0db4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:13.041581 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553c55-672c-4bab-b0cf-067af9e0db4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:13.043986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553c55-672c-4bab-b0cf-067af9e0db4c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:13.055831 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 329/656] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:13.056666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553c55-672c-4bab-b0cf-067af9e0db4c None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:13.112183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:13.114951 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025744a-b727-41f6-823f-011b550923df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:13.117263 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025744a-b727-41f6-823f-011b550923df None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:13.138780 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:13.169235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553c55-672c-4bab-b0cf-067af9e0db4c None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:13.209026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937cf38-e2e9-4ca1-ab65-f0dbfddab0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:13.209828 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937cf38-e2e9-4ca1-ab65-f0dbfddab0dd None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:13.210111 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937cf38-e2e9-4ca1-ab65-f0dbfddab0dd None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:13.210397 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937cf38-e2e9-4ca1-ab65-f0dbfddab0dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:13.222441 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937cf38-e2e9-4ca1-ab65-f0dbfddab0dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:13.223956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937cf38-e2e9-4ca1-ab65-f0dbfddab0dd None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:13.233713 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 328/657] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:41:13.234965 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025744a-b727-41f6-823f-011b550923df None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-c937cf38-e2e9-4ca1-ab65-f0dbfddab0dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:13.242162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:13.243255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:13.244245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:13.244245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:13.244245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:13.244245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:13.244245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 330/658] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:13.245829 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9342-28db-4970-9088-cde930a9098c None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:13.245829 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9342-28db-4970-9088-cde930a9098c None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:13.246144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9342-28db-4970-9088-cde930a9098c None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:13.247532 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 331/659] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:13.248922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f9342-28db-4970-9088-cde930a9098c None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:13.343959 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025744a-b727-41f6-823f-011b550923df None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:13.359552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:13.364329 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f9342-28db-4970-9088-cde930a9098c None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:13.369624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:13.385543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc0cf-9d2f-4fc2-a7b7-b78bf4e30def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:13.385543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc0cf-9d2f-4fc2-a7b7-b78bf4e30def None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:13.385543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc0cf-9d2f-4fc2-a7b7-b78bf4e30def None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:13.386904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc0cf-9d2f-4fc2-a7b7-b78bf4e30def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:13.387853 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cc0cf-9d2f-4fc2-a7b7-b78bf4e30def None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=62fbf54d04f84afd8dd9270b17207b04) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:13.387853 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cc0cf-9d2f-4fc2-a7b7-b78bf4e30def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:13.389308 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cc0cf-9d2f-4fc2-a7b7-b78bf4e30def None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:13.395501 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 329/660] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:13 2022] GET /identity/v3/role_assignments?user.id=62fbf54d04f84afd8dd9270b17207b04&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:13.396327 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc0cf-9d2f-4fc2-a7b7-b78bf4e30def None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:13.403691 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059dded-fbae-4b35-87a1-599017662f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:13.404865 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059dded-fbae-4b35-87a1-599017662f08 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:13.405171 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059dded-fbae-4b35-87a1-599017662f08 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:13.405441 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059dded-fbae-4b35-87a1-599017662f08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:13.414728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059dded-fbae-4b35-87a1-599017662f08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:13.416330 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059dded-fbae-4b35-87a1-599017662f08 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-5059dded-fbae-4b35-87a1-599017662f08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:13.433879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:13.434976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:13.435882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:13.435882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:13.435882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:13.435882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:13.435882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:13.435882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:13.435882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:13.435882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:13.435882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 332/661] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:13.436418 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059dded-fbae-4b35-87a1-599017662f08 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:13.549052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc0cf-9d2f-4fc2-a7b7-b78bf4e30def None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:13.569152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059dded-fbae-4b35-87a1-599017662f08 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:13.587426 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06c2bb-de09-49ee-8be2-fe1c7c3c2dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:13.588423 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06c2bb-de09-49ee-8be2-fe1c7c3c2dee None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:13.589782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06c2bb-de09-49ee-8be2-fe1c7c3c2dee None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:13.589782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06c2bb-de09-49ee-8be2-fe1c7c3c2dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:13.605894 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06c2bb-de09-49ee-8be2-fe1c7c3c2dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:13.607744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06c2bb-de09-49ee-8be2-fe1c7c3c2dee None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:13.614875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada21ee-0b3a-40e8-a3cb-f7c5a971665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:13.615552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada21ee-0b3a-40e8-a3cb-f7c5a971665f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:13.615836 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada21ee-0b3a-40e8-a3cb-f7c5a971665f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:13.616156 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada21ee-0b3a-40e8-a3cb-f7c5a971665f None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:13.616883 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada21ee-0b3a-40e8-a3cb-f7c5a971665f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:13.617194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada21ee-0b3a-40e8-a3cb-f7c5a971665f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:13.618587 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada21ee-0b3a-40e8-a3cb-f7c5a971665f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-6b06c2bb-de09-49ee-8be2-fe1c7c3c2dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:13.627123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:13.629515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:13.630492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:13.630492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:13.630492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:13.630492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:13.630492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 330/662] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:13.630768 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7913f65-6f1f-441b-ad01-45d8a7058e06 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:13.630875 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7913f65-6f1f-441b-ad01-45d8a7058e06 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:13.631158 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7913f65-6f1f-441b-ad01-45d8a7058e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:13.635195 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 333/663] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:13.636771 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada21ee-0b3a-40e8-a3cb-f7c5a971665f None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:13.656370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-e7913f65-6f1f-441b-ad01-45d8a7058e06 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:13.657599 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-e7913f65-6f1f-441b-ad01-45d8a7058e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:13.663702 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:13.694716 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:13.742694 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 331/664] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:13.743637 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7913f65-6f1f-441b-ad01-45d8a7058e06 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:13.768886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada21ee-0b3a-40e8-a3cb-f7c5a971665f None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:13.805007 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68231e-cfd7-4b9c-91cc-2098904a4b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:13.805795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68231e-cfd7-4b9c-91cc-2098904a4b2f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:13.806152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68231e-cfd7-4b9c-91cc-2098904a4b2f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:13.806507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68231e-cfd7-4b9c-91cc-2098904a4b2f None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:13.807357 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68231e-cfd7-4b9c-91cc-2098904a4b2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:13.807657 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68231e-cfd7-4b9c-91cc-2098904a4b2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:13.809272 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68231e-cfd7-4b9c-91cc-2098904a4b2f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:13.828254 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 334/665] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:13.828254 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68231e-cfd7-4b9c-91cc-2098904a4b2f None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:13.856594 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7913f65-6f1f-441b-ad01-45d8a7058e06 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:13.896079 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af5c97-e7b7-4a94-adab-b5137ab21ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:13.896788 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af5c97-e7b7-4a94-adab-b5137ab21ff8 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:13.897071 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af5c97-e7b7-4a94-adab-b5137ab21ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:13.897347 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af5c97-e7b7-4a94-adab-b5137ab21ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:13.898086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af5c97-e7b7-4a94-adab-b5137ab21ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:13.898393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af5c97-e7b7-4a94-adab-b5137ab21ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:13.899781 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af5c97-e7b7-4a94-adab-b5137ab21ff8 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:13.916460 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 332/666] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:13.917631 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af5c97-e7b7-4a94-adab-b5137ab21ff8 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:13.919022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:13.941477 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68231e-cfd7-4b9c-91cc-2098904a4b2f None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:13.950849 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:13.980962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd4a40-e516-4205-8d6d-274bbd4d5654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:13.982030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd4a40-e516-4205-8d6d-274bbd4d5654 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:13.982309 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd4a40-e516-4205-8d6d-274bbd4d5654 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:13.982586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd4a40-e516-4205-8d6d-274bbd4d5654 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:13.990253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd4a40-e516-4205-8d6d-274bbd4d5654 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:13.991715 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd4a40-e516-4205-8d6d-274bbd4d5654 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-a7fd4a40-e516-4205-8d6d-274bbd4d5654 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:14.006844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:14.007856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:14.008869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:14.008869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:14.008869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:14.008869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:14.008869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:14.008869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:14.008869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:14.008869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:14.008869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:41:14.008869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:14.012458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 335/667] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:14.014103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd4a40-e516-4205-8d6d-274bbd4d5654 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:14.038499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af5c97-e7b7-4a94-adab-b5137ab21ff8 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:14.075758 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb4f55-9c71-436c-9107-64124def86cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:14.076975 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb4f55-9c71-436c-9107-64124def86cc None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:14.077477 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb4f55-9c71-436c-9107-64124def86cc None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:14.077910 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb4f55-9c71-436c-9107-64124def86cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:14.088986 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb4f55-9c71-436c-9107-64124def86cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-33bb4f55-9c71-436c-9107-64124def86cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:14.097013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:14.097969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:14.098840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 333/668] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:14.100321 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb4f55-9c71-436c-9107-64124def86cc None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:14.126502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd4a40-e516-4205-8d6d-274bbd4d5654 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:14.164979 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b46a-4b19-4d18-8971-caa3d6088660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:14.165638 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b46a-4b19-4d18-8971-caa3d6088660 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:14.165922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b46a-4b19-4d18-8971-caa3d6088660 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:14.166198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b46a-4b19-4d18-8971-caa3d6088660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:14.167230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7b46a-4b19-4d18-8971-caa3d6088660 None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=971eae8a8ad44ce893c311b74acbd76b) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:14.167544 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7b46a-4b19-4d18-8971-caa3d6088660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:14.169025 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7b46a-4b19-4d18-8971-caa3d6088660 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:14.175181 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 336/669] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:14 2022] GET /identity/v3/role_assignments?user.id=971eae8a8ad44ce893c311b74acbd76b&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:14.175991 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b46a-4b19-4d18-8971-caa3d6088660 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:14.188231 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:14.207728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:14.227399 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb4f55-9c71-436c-9107-64124def86cc None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:14.269619 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8a11f-e11e-4279-8cdb-5bdba5eb5564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:14.270554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8a11f-e11e-4279-8cdb-5bdba5eb5564 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:14.270909 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8a11f-e11e-4279-8cdb-5bdba5eb5564 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:14.271255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8a11f-e11e-4279-8cdb-5bdba5eb5564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:14.279768 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8a11f-e11e-4279-8cdb-5bdba5eb5564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:14.281454 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8a11f-e11e-4279-8cdb-5bdba5eb5564 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-fac8a11f-e11e-4279-8cdb-5bdba5eb5564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:14.298157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:14.299342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:14.300491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:14.300491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:14.300491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:14.300491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:14.300491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:14.300491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:14.300491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:14.300491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:14.306786 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 334/670] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:14.308519 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8a11f-e11e-4279-8cdb-5bdba5eb5564 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:14.443668 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8a11f-e11e-4279-8cdb-5bdba5eb5564 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:14.445477 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b46a-4b19-4d18-8971-caa3d6088660 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:14.499326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ac44a-ff27-4d40-9b10-d5a284110576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:14.500018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ac44a-ff27-4d40-9b10-d5a284110576 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:14.500342 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ac44a-ff27-4d40-9b10-d5a284110576 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:14.500618 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ac44a-ff27-4d40-9b10-d5a284110576 None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:14.500923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f417af7-a622-4d82-bd16-c885e4d0012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:14.501474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ac44a-ff27-4d40-9b10-d5a284110576 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:14.501783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ac44a-ff27-4d40-9b10-d5a284110576 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:14.502342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f417af7-a622-4d82-bd16-c885e4d0012e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:14.502828 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f417af7-a622-4d82-bd16-c885e4d0012e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:14.503246 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ac44a-ff27-4d40-9b10-d5a284110576 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:14.503497 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f417af7-a622-4d82-bd16-c885e4d0012e None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:14.504492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f417af7-a622-4d82-bd16-c885e4d0012e None admin] RBAC: Adding query filter params (name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:14.504981 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f417af7-a622-4d82-bd16-c885e4d0012e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:14.506607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f417af7-a622-4d82-bd16-c885e4d0012e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:14.517290 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 335/671] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:14.518437 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f417af7-a622-4d82-bd16-c885e4d0012e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:14.531571 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:14.532025 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 337/672] 10.222.0.24 () {56 vars in 1139 bytes} [Wed May 25 13:41:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:14.532940 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ac44a-ff27-4d40-9b10-d5a284110576 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:14.614106 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:14.645004 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f417af7-a622-4d82-bd16-c885e4d0012e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:14.659543 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ac44a-ff27-4d40-9b10-d5a284110576 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:14.683516 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae9818-48bb-4da3-ae4a-99d8fc6fb4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:14.684219 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae9818-48bb-4da3-ae4a-99d8fc6fb4a8 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:14.684510 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae9818-48bb-4da3-ae4a-99d8fc6fb4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:14.684791 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae9818-48bb-4da3-ae4a-99d8fc6fb4a8 None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:14.685606 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae9818-48bb-4da3-ae4a-99d8fc6fb4a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:14.685924 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae9818-48bb-4da3-ae4a-99d8fc6fb4a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:14.687914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae9818-48bb-4da3-ae4a-99d8fc6fb4a8 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:14.702651 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 336/673] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:14.703804 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae9818-48bb-4da3-ae4a-99d8fc6fb4a8 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:14.707732 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc8857-6c2c-47fa-9d5f-025cbaa7ac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:14.708574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc8857-6c2c-47fa-9d5f-025cbaa7ac99 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:14.708860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc8857-6c2c-47fa-9d5f-025cbaa7ac99 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:14.709131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc8857-6c2c-47fa-9d5f-025cbaa7ac99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:14.723921 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc8857-6c2c-47fa-9d5f-025cbaa7ac99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:14.725696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc8857-6c2c-47fa-9d5f-025cbaa7ac99 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-88bc8857-6c2c-47fa-9d5f-025cbaa7ac99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:14.744554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:14.746152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:14.747045 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:14.747045 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:14.747045 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:14.747045 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:14.750995 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 338/674] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:14.751883 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc8857-6c2c-47fa-9d5f-025cbaa7ac99 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:14.793317 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:14.842269 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae9818-48bb-4da3-ae4a-99d8fc6fb4a8 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:14.880830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd89827-7064-4f51-9ebd-e4b6058bfc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:14.881639 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89827-7064-4f51-9ebd-e4b6058bfc44 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:14.882024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89827-7064-4f51-9ebd-e4b6058bfc44 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:14.882403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89827-7064-4f51-9ebd-e4b6058bfc44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:14.882780 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc8857-6c2c-47fa-9d5f-025cbaa7ac99 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:14.898891 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:14.924093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6ec0c-3ea9-4d5e-ac45-cf0d4da390ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:14.925024 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6ec0c-3ea9-4d5e-ac45-cf0d4da390ae None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:14.925482 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6ec0c-3ea9-4d5e-ac45-cf0d4da390ae None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:14.926024 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6ec0c-3ea9-4d5e-ac45-cf0d4da390ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:14.927059 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6ec0c-3ea9-4d5e-ac45-cf0d4da390ae None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=ac053a5b34cb4fd8a4fb8b0dfa80e922) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:14.927560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6ec0c-3ea9-4d5e-ac45-cf0d4da390ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:14.929340 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6ec0c-3ea9-4d5e-ac45-cf0d4da390ae None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:14.937025 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 339/675] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:14 2022] GET /identity/v3/role_assignments?user.id=ac053a5b34cb4fd8a4fb8b0dfa80e922&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:14.938115 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6ec0c-3ea9-4d5e-ac45-cf0d4da390ae None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:14.956390 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd89827-7064-4f51-9ebd-e4b6058bfc44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:14.957841 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd89827-7064-4f51-9ebd-e4b6058bfc44 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:15.070031 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6ec0c-3ea9-4d5e-ac45-cf0d4da390ae None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:15.077571 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:15.123547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35ae71-1c03-4ca1-a0d2-1dfe168ccce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:15.124719 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35ae71-1c03-4ca1-a0d2-1dfe168ccce4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:15.125281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35ae71-1c03-4ca1-a0d2-1dfe168ccce4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:15.125897 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35ae71-1c03-4ca1-a0d2-1dfe168ccce4 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:15.126876 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35ae71-1c03-4ca1-a0d2-1dfe168ccce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:15.127408 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35ae71-1c03-4ca1-a0d2-1dfe168ccce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:15.129320 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35ae71-1c03-4ca1-a0d2-1dfe168ccce4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:15.145374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 340/676] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:15.150200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 337/677] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:41:15.155826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd89827-7064-4f51-9ebd-e4b6058bfc44 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:15.156064 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35ae71-1c03-4ca1-a0d2-1dfe168ccce4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:15.218625 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:15.273820 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd89827-7064-4f51-9ebd-e4b6058bfc44 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:15.290577 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35ae71-1c03-4ca1-a0d2-1dfe168ccce4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:15.310470 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504a6dc-32f3-4baa-9823-157490aba5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:15.311285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504a6dc-32f3-4baa-9823-157490aba5aa None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:15.311563 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504a6dc-32f3-4baa-9823-157490aba5aa None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:15.311842 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504a6dc-32f3-4baa-9823-157490aba5aa None admin] PATH_INFO: `/v3/users/swift` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:15.319646 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504a6dc-32f3-4baa-9823-157490aba5aa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:15.321006 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504a6dc-32f3-4baa-9823-157490aba5aa None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:15.332041 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbcf03-4578-4a0b-ac59-c889aa13f185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:15.333286 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbcf03-4578-4a0b-ac59-c889aa13f185 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:15.333777 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbcf03-4578-4a0b-ac59-c889aa13f185 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:15.334264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbcf03-4578-4a0b-ac59-c889aa13f185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-5504a6dc-32f3-4baa-9823-157490aba5aa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:15.336500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:15.337453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:15.338526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:15.338526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:15.338526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:15.338526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:15.338526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:15.338526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:15.338526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:15.338526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:15.338526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:41:15.338526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:15.338526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 338/678] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:41:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:15.344066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504a6dc-32f3-4baa-9823-157490aba5aa None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:15.351025 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbcf03-4578-4a0b-ac59-c889aa13f185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:15.352988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbcf03-4578-4a0b-ac59-c889aa13f185 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-ffbbcf03-4578-4a0b-ac59-c889aa13f185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:15.374043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:15.375026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:15.375966 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:15.375966 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:15.375966 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:15.375966 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:15.376959 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:15.379062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 341/679] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:15.384908 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbcf03-4578-4a0b-ac59-c889aa13f185 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:15.473705 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504a6dc-32f3-4baa-9823-157490aba5aa None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:15.513408 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:15.514410 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409672df-237d-4735-a054-c99cf3f64b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:15.515399 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409672df-237d-4735-a054-c99cf3f64b34 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:15.515847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409672df-237d-4735-a054-c99cf3f64b34 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:15.515847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409672df-237d-4735-a054-c99cf3f64b34 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:15.516779 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409672df-237d-4735-a054-c99cf3f64b34 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:15.517160 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409672df-237d-4735-a054-c99cf3f64b34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:15.518712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409672df-237d-4735-a054-c99cf3f64b34 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:15.526891 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbcf03-4578-4a0b-ac59-c889aa13f185 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:15.538238 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 339/680] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 13:41:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:15.544529 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409672df-237d-4735-a054-c99cf3f64b34 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:15.578020 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c47d9-1422-4918-8007-33c67c6accb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:15.578694 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c47d9-1422-4918-8007-33c67c6accb4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:15.578977 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c47d9-1422-4918-8007-33c67c6accb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:15.579251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c47d9-1422-4918-8007-33c67c6accb4 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:15.579993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c47d9-1422-4918-8007-33c67c6accb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:15.581547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c47d9-1422-4918-8007-33c67c6accb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:15.584455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c47d9-1422-4918-8007-33c67c6accb4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:15.607060 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 342/681] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:15.612071 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c47d9-1422-4918-8007-33c67c6accb4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:15.697316 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:15.729425 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409672df-237d-4735-a054-c99cf3f64b34 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:15.806888 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c47d9-1422-4918-8007-33c67c6accb4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:15.811296 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bacaa-1161-4b9e-8da7-b14ef73a363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:15.811969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bacaa-1161-4b9e-8da7-b14ef73a363c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:15.812278 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bacaa-1161-4b9e-8da7-b14ef73a363c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:15.812553 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bacaa-1161-4b9e-8da7-b14ef73a363c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:15.875946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822dc2-25cb-41e0-8b33-8f13e736cea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:15.876790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822dc2-25cb-41e0-8b33-8f13e736cea4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:15.877104 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822dc2-25cb-41e0-8b33-8f13e736cea4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:15.877324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822dc2-25cb-41e0-8b33-8f13e736cea4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:15.893453 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e822dc2-25cb-41e0-8b33-8f13e736cea4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:15.894933 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e822dc2-25cb-41e0-8b33-8f13e736cea4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-1e822dc2-25cb-41e0-8b33-8f13e736cea4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:15.918448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:15.919440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:15.920383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:15.920383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:15.920383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:15.920383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:15.920383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:15.920383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:15.920383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:15.920383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:15.925184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 343/682] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:15.934226 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822dc2-25cb-41e0-8b33-8f13e736cea4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:15.958144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:15.959572 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bacaa-1161-4b9e-8da7-b14ef73a363c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:15.961073 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bacaa-1161-4b9e-8da7-b14ef73a363c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:16.129483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822dc2-25cb-41e0-8b33-8f13e736cea4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:16.132448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:16.165800 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 340/683] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:41:16.173711 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bacaa-1161-4b9e-8da7-b14ef73a363c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:16.193259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f7b1d-b1a2-4750-a799-eca9240d7bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:16.193937 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f7b1d-b1a2-4750-a799-eca9240d7bd6 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:16.194216 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f7b1d-b1a2-4750-a799-eca9240d7bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:16.194491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f7b1d-b1a2-4750-a799-eca9240d7bd6 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:16.195285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f7b1d-b1a2-4750-a799-eca9240d7bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:16.195592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f7b1d-b1a2-4750-a799-eca9240d7bd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:16.197075 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f7b1d-b1a2-4750-a799-eca9240d7bd6 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:16.214558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 344/684] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:16.220850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1662e57-b21b-4422-b59a-60e9cf95f95a None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:16.221050 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1662e57-b21b-4422-b59a-60e9cf95f95a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:16.221334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1662e57-b21b-4422-b59a-60e9cf95f95a None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:16.227055 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 345/685] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:16.227055 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1662e57-b21b-4422-b59a-60e9cf95f95a None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:16.311291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:16.321538 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bacaa-1161-4b9e-8da7-b14ef73a363c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:16.349978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1662e57-b21b-4422-b59a-60e9cf95f95a None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:16.371926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0d743-559f-4b2b-9f34-9efc95933983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:16.372774 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0d743-559f-4b2b-9f34-9efc95933983 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:16.373055 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0d743-559f-4b2b-9f34-9efc95933983 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:16.373327 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0d743-559f-4b2b-9f34-9efc95933983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:16.388188 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0d743-559f-4b2b-9f34-9efc95933983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:16.389602 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0d743-559f-4b2b-9f34-9efc95933983 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:16.391929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5d5f6-4867-4b15-af5b-be573c6a71b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:16.392917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5d5f6-4867-4b15-af5b-be573c6a71b1 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:16.393398 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5d5f6-4867-4b15-af5b-be573c6a71b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:16.393867 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5d5f6-4867-4b15-af5b-be573c6a71b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:16.394967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5d5f6-4867-4b15-af5b-be573c6a71b1 None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=e29f2382dd6f4f648c31f12240ba5793) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:16.395484 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5d5f6-4867-4b15-af5b-be573c6a71b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:16.397281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5d5f6-4867-4b15-af5b-be573c6a71b1 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:16.405215 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 346/686] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:16 2022] GET /identity/v3/role_assignments?user.id=e29f2382dd6f4f648c31f12240ba5793&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:16.406806 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55fe99-72a6-41da-9c3a-b744f3b2c1cb None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:16.407314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55fe99-72a6-41da-9c3a-b744f3b2c1cb None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:16.407794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55fe99-72a6-41da-9c3a-b744f3b2c1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-a4c0d743-559f-4b2b-9f34-9efc95933983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:16.423652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:16.424666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:16.425556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:16.425556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:16.425556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:16.425556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:16.427784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 341/687] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:16.434997 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0d743-559f-4b2b-9f34-9efc95933983 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:16.440752 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-ef55fe99-72a6-41da-9c3a-b744f3b2c1cb None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:16.446812 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-ef55fe99-72a6-41da-9c3a-b744f3b2c1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:16.517512 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:16.575923 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 347/688] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:16.620691 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0d743-559f-4b2b-9f34-9efc95933983 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:16.627194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55fe99-72a6-41da-9c3a-b744f3b2c1cb None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:16.687370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8255b9-39c0-4313-950c-93d0a06f1ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:16.688013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8255b9-39c0-4313-950c-93d0a06f1ca0 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:16.688533 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8255b9-39c0-4313-950c-93d0a06f1ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:16.688817 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8255b9-39c0-4313-950c-93d0a06f1ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:16.690560 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8255b9-39c0-4313-950c-93d0a06f1ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:16.690877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8255b9-39c0-4313-950c-93d0a06f1ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:16.692325 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8255b9-39c0-4313-950c-93d0a06f1ca0 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:16.712942 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 342/689] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:16.715499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8255b9-39c0-4313-950c-93d0a06f1ca0 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:16.748975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:16.806095 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55fe99-72a6-41da-9c3a-b744f3b2c1cb None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:16.853670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588ce5a-89f3-4e58-9a72-7d30f9dc92d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:16.856706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588ce5a-89f3-4e58-9a72-7d30f9dc92d3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:16.857231 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588ce5a-89f3-4e58-9a72-7d30f9dc92d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:16.857655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588ce5a-89f3-4e58-9a72-7d30f9dc92d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:16.873322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:16.874175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588ce5a-89f3-4e58-9a72-7d30f9dc92d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:16.876636 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588ce5a-89f3-4e58-9a72-7d30f9dc92d3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:16.878845 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8255b9-39c0-4313-950c-93d0a06f1ca0 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-1588ce5a-89f3-4e58-9a72-7d30f9dc92d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:16.900722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:16.901899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:16.902988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:16.902988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:16.902988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:16.902988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:16.905913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 348/690] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:16.907510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c1ab1-351f-4c80-8961-438848f35508 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:16.907927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c1ab1-351f-4c80-8961-438848f35508 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:16.908353 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c1ab1-351f-4c80-8961-438848f35508 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:16.910198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 349/691] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:16.915410 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74f38e-8b57-4b9a-af73-5dad1fcdcbc6 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:16.915690 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74f38e-8b57-4b9a-af73-5dad1fcdcbc6 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:16.915959 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74f38e-8b57-4b9a-af73-5dad1fcdcbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:16.938966 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-bd74f38e-8b57-4b9a-af73-5dad1fcdcbc6 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:16.940108 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-bd74f38e-8b57-4b9a-af73-5dad1fcdcbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:16.940463 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fce27-a74c-43ce-94b9-8fe4b26bb062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:16.941523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fce27-a74c-43ce-94b9-8fe4b26bb062 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:16.942286 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fce27-a74c-43ce-94b9-8fe4b26bb062 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:16.942765 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fce27-a74c-43ce-94b9-8fe4b26bb062 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:16.952620 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fce27-a74c-43ce-94b9-8fe4b26bb062 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:16.954899 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fce27-a74c-43ce-94b9-8fe4b26bb062 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-e82fce27-a74c-43ce-94b9-8fe4b26bb062 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:16.975566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:16.976545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:16.977530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:16.977530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:16.977530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:16.977530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:16.977530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:16.977530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:16.977530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:16.977530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:16.977963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 343/692] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:16.980305 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fce27-a74c-43ce-94b9-8fe4b26bb062 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:17.037312 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 350/693] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:41:17.038184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74f38e-8b57-4b9a-af73-5dad1fcdcbc6 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:17.105751 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fce27-a74c-43ce-94b9-8fe4b26bb062 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:17.110477 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:17.147057 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3627d-0c56-4ed3-8ee6-f08b241e3c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:17.147753 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3627d-0c56-4ed3-8ee6-f08b241e3c4c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:17.148038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3627d-0c56-4ed3-8ee6-f08b241e3c4c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:17.148369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3627d-0c56-4ed3-8ee6-f08b241e3c4c None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:17.149168 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3627d-0c56-4ed3-8ee6-f08b241e3c4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:17.149477 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3627d-0c56-4ed3-8ee6-f08b241e3c4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:17.151632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3627d-0c56-4ed3-8ee6-f08b241e3c4c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:17.165722 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 344/694] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:17.166776 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3627d-0c56-4ed3-8ee6-f08b241e3c4c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:17.187833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74f38e-8b57-4b9a-af73-5dad1fcdcbc6 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:17.190174 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:17.248223 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2e9a9-7079-4dbe-94ad-8b569d84f89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:17.249164 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2e9a9-7079-4dbe-94ad-8b569d84f89e None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:17.249594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2e9a9-7079-4dbe-94ad-8b569d84f89e None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:17.250322 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2e9a9-7079-4dbe-94ad-8b569d84f89e None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:17.251969 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2e9a9-7079-4dbe-94ad-8b569d84f89e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:17.252475 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2e9a9-7079-4dbe-94ad-8b569d84f89e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:17.254684 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2e9a9-7079-4dbe-94ad-8b569d84f89e None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:17.272241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 351/695] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:17.273728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2e9a9-7079-4dbe-94ad-8b569d84f89e None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:17.300757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3627d-0c56-4ed3-8ee6-f08b241e3c4c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:17.341788 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7cb77-4122-404a-b633-a914ffbef7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:17.342670 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7cb77-4122-404a-b633-a914ffbef7b1 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:17.342955 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7cb77-4122-404a-b633-a914ffbef7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:17.343227 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7cb77-4122-404a-b633-a914ffbef7b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:17.357974 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7cb77-4122-404a-b633-a914ffbef7b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-50c7cb77-4122-404a-b633-a914ffbef7b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:17.365824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:17.367052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:17.367960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 345/696] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:17.368803 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7cb77-4122-404a-b633-a914ffbef7b1 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:17.425164 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2e9a9-7079-4dbe-94ad-8b569d84f89e None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:17.435136 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:17.467140 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:17.475932 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed6aae-1282-44c1-962c-01d522e527f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:17.476893 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed6aae-1282-44c1-962c-01d522e527f5 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:17.477357 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed6aae-1282-44c1-962c-01d522e527f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:17.477785 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed6aae-1282-44c1-962c-01d522e527f5 None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:17.479040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed6aae-1282-44c1-962c-01d522e527f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:17.480879 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed6aae-1282-44c1-962c-01d522e527f5 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:17.504969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7cb77-4122-404a-b633-a914ffbef7b1 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:17.512521 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 352/697] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:41:17 2022] POST /identity/v3/users => generated 254 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:41:17.513536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed6aae-1282-44c1-962c-01d522e527f5 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:17.560509 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdb5bd-085d-4464-85e6-b57ff163566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:17.561501 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdb5bd-085d-4464-85e6-b57ff163566a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:17.561973 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdb5bd-085d-4464-85e6-b57ff163566a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:17.562255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdb5bd-085d-4464-85e6-b57ff163566a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:17.563232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdb5bd-085d-4464-85e6-b57ff163566a None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=41c94d4eb019422fbea20bba97fa77a4) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:17.563554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdb5bd-085d-4464-85e6-b57ff163566a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:17.566110 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdb5bd-085d-4464-85e6-b57ff163566a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:17.577158 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 346/698] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:17 2022] GET /identity/v3/role_assignments?user.id=41c94d4eb019422fbea20bba97fa77a4&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:17.670380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed6aae-1282-44c1-962c-01d522e527f5 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:17.727612 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcca8e1-8807-4865-8fbc-70f3d84229bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:17.728773 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcca8e1-8807-4865-8fbc-70f3d84229bc None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:17.729895 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcca8e1-8807-4865-8fbc-70f3d84229bc None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:17.730421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcca8e1-8807-4865-8fbc-70f3d84229bc None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:17.731473 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcca8e1-8807-4865-8fbc-70f3d84229bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:17.732013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcca8e1-8807-4865-8fbc-70f3d84229bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:17.733690 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcca8e1-8807-4865-8fbc-70f3d84229bc None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:17.744573 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 353/699] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:17.753295 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdb5bd-085d-4464-85e6-b57ff163566a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:17.828757 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4123da1-ff9e-4d78-97db-0645126f8e59 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:17.829394 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4123da1-ff9e-4d78-97db-0645126f8e59 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:17.830216 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4123da1-ff9e-4d78-97db-0645126f8e59 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:17.832470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 354/700] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:17.840785 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25608e61-21e7-4f9f-bc7a-93b83e41f82f None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:17.841377 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25608e61-21e7-4f9f-bc7a-93b83e41f82f None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:17.841377 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25608e61-21e7-4f9f-bc7a-93b83e41f82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:17.861416 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-25608e61-21e7-4f9f-bc7a-93b83e41f82f None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:17.862620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-25608e61-21e7-4f9f-bc7a-93b83e41f82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:17.884526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:17.912281 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdb5bd-085d-4464-85e6-b57ff163566a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:17.953843 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 355/701] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:41:17.958370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45bff-bba0-49a9-b831-169c696df488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:17.959175 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45bff-bba0-49a9-b831-169c696df488 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:17.959462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45bff-bba0-49a9-b831-169c696df488 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:17.959742 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45bff-bba0-49a9-b831-169c696df488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:17.971925 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e45bff-bba0-49a9-b831-169c696df488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:17.973425 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e45bff-bba0-49a9-b831-169c696df488 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:17.976344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:17.976909 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25608e61-21e7-4f9f-bc7a-93b83e41f82f None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-54e45bff-bba0-49a9-b831-169c696df488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:17.997759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:17.998657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:17.999572 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:17.999572 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:17.999572 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:17.999572 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:18.000382 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 347/702] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:18.010825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45bff-bba0-49a9-b831-169c696df488 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:18.117904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25608e61-21e7-4f9f-bc7a-93b83e41f82f None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:18.158832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c834d06-164c-4589-b405-0ab3f0d8a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:18.159648 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c834d06-164c-4589-b405-0ab3f0d8a38c None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:18.159932 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c834d06-164c-4589-b405-0ab3f0d8a38c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:18.160239 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c834d06-164c-4589-b405-0ab3f0d8a38c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:18.160900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c834d06-164c-4589-b405-0ab3f0d8a38c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:18.163810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c834d06-164c-4589-b405-0ab3f0d8a38c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:18.169856 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45bff-bba0-49a9-b831-169c696df488 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-1c834d06-164c-4589-b405-0ab3f0d8a38c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:18.189034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:18.190133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:18.191202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 356/703] 10.222.0.24 () {56 vars in 1129 bytes} [Wed May 25 13:41:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:18.202451 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c834d06-164c-4589-b405-0ab3f0d8a38c None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:18.242348 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db674f6-6da1-40ba-b18b-d43d6616a7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:18.243077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db674f6-6da1-40ba-b18b-d43d6616a7e0 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:18.243359 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db674f6-6da1-40ba-b18b-d43d6616a7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:18.243635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db674f6-6da1-40ba-b18b-d43d6616a7e0 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:18.244842 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db674f6-6da1-40ba-b18b-d43d6616a7e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:18.245092 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:18.245359 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db674f6-6da1-40ba-b18b-d43d6616a7e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:18.246456 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db674f6-6da1-40ba-b18b-d43d6616a7e0 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:18.278946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 348/704] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:18.284200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db674f6-6da1-40ba-b18b-d43d6616a7e0 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:18.390243 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:18.393704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c834d06-164c-4589-b405-0ab3f0d8a38c None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:18.434832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b826f5f-bd27-49e1-afa5-215584bf167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:18.435920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b826f5f-bd27-49e1-afa5-215584bf167a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:18.436462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b826f5f-bd27-49e1-afa5-215584bf167a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:18.437052 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b826f5f-bd27-49e1-afa5-215584bf167a None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:18.438012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b826f5f-bd27-49e1-afa5-215584bf167a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:18.438572 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b826f5f-bd27-49e1-afa5-215584bf167a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:18.440480 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b826f5f-bd27-49e1-afa5-215584bf167a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:18.446250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 357/705] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 13:41:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:18.451853 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b826f5f-bd27-49e1-afa5-215584bf167a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:18.479728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db674f6-6da1-40ba-b18b-d43d6616a7e0 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:18.545859 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ed581-907a-4366-b5c2-e0254df1834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:18.547029 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ed581-907a-4366-b5c2-e0254df1834f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:18.547562 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ed581-907a-4366-b5c2-e0254df1834f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:18.548043 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ed581-907a-4366-b5c2-e0254df1834f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:18.564302 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:18.565837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ed581-907a-4366-b5c2-e0254df1834f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:18.567852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ed581-907a-4366-b5c2-e0254df1834f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:18.571831 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b826f5f-bd27-49e1-afa5-215584bf167a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-099ed581-907a-4366-b5c2-e0254df1834f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:18.593173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:18.594222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:18.595169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:18.595169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:18.595169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:18.595169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:18.595169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:18.595169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:18.595169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:18.595169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:18.595169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:41:18.595169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:18.597818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 349/706] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 13:41:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:18.605685 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ed581-907a-4366-b5c2-e0254df1834f None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:18.608373 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f439-38a7-43b6-9ca1-b6e4e9ca0d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:18.609370 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f439-38a7-43b6-9ca1-b6e4e9ca0d65 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:18.609657 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f439-38a7-43b6-9ca1-b6e4e9ca0d65 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:18.609929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f439-38a7-43b6-9ca1-b6e4e9ca0d65 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:18.611374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2f439-38a7-43b6-9ca1-b6e4e9ca0d65 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:18.611374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2f439-38a7-43b6-9ca1-b6e4e9ca0d65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:18.612429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2f439-38a7-43b6-9ca1-b6e4e9ca0d65 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:18.624162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 358/707] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 13:41:18 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:18.726831 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ed581-907a-4366-b5c2-e0254df1834f None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:18.748741 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:18.778252 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4702548-73ef-46d8-884b-999765d8a858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:18.778927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4702548-73ef-46d8-884b-999765d8a858 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:18.779209 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4702548-73ef-46d8-884b-999765d8a858 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:18.779486 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4702548-73ef-46d8-884b-999765d8a858 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:18.780365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4702548-73ef-46d8-884b-999765d8a858 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:18.780674 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4702548-73ef-46d8-884b-999765d8a858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:18.782162 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4702548-73ef-46d8-884b-999765d8a858 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:18.811206 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 350/708] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 13:41:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:18.817490 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f439-38a7-43b6-9ca1-b6e4e9ca0d65 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:18.973188 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f439-38a7-43b6-9ca1-b6e4e9ca0d65 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:19.009366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba4a09-7dfb-498d-a144-5d7ec537e9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:19.011286 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba4a09-7dfb-498d-a144-5d7ec537e9f8 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:19.011792 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba4a09-7dfb-498d-a144-5d7ec537e9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:19.012324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba4a09-7dfb-498d-a144-5d7ec537e9f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:19.031675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:19.088654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba4a09-7dfb-498d-a144-5d7ec537e9f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:19.090048 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba4a09-7dfb-498d-a144-5d7ec537e9f8 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:19.231367 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 359/709] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:41:19.236706 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4702548-73ef-46d8-884b-999765d8a858 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:19.318712 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca17a6-4f51-4c1f-9adf-de9942b8234a None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:19.319031 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca17a6-4f51-4c1f-9adf-de9942b8234a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:19.319261 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca17a6-4f51-4c1f-9adf-de9942b8234a None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:19.320646 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 360/710] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:41:19.326618 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf52fe4-3b8d-4ee3-b243-98b31038248c None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:19.326913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf52fe4-3b8d-4ee3-b243-98b31038248c None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:19.327191 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf52fe4-3b8d-4ee3-b243-98b31038248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:19.352698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-baf52fe4-3b8d-4ee3-b243-98b31038248c None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:19.354351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-baf52fe4-3b8d-4ee3-b243-98b31038248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:19.391992 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4702548-73ef-46d8-884b-999765d8a858 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:19.433977 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:19.457816 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f930a1-446b-4cbc-aea6-d497e893c01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:19.458642 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f930a1-446b-4cbc-aea6-d497e893c01b None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:19.459071 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f930a1-446b-4cbc-aea6-d497e893c01b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:19.459348 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f930a1-446b-4cbc-aea6-d497e893c01b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:19.482578 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f930a1-446b-4cbc-aea6-d497e893c01b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:19.484233 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f930a1-446b-4cbc-aea6-d497e893c01b None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-11f930a1-446b-4cbc-aea6-d497e893c01b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:19.503038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:19.504189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:19.505384 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:19.505384 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:19.505384 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:19.505384 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:19.505384 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 351/711] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:19.506342 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 361/712] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:19.511539 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f930a1-446b-4cbc-aea6-d497e893c01b None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:19.556351 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:19.557225 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf52fe4-3b8d-4ee3-b243-98b31038248c None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:19.635526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f930a1-446b-4cbc-aea6-d497e893c01b None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:19.671012 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9cd2f-45f9-4c54-9c18-ad0df1c065a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:19.671693 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9cd2f-45f9-4c54-9c18-ad0df1c065a6 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:19.671984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9cd2f-45f9-4c54-9c18-ad0df1c065a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:19.672313 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9cd2f-45f9-4c54-9c18-ad0df1c065a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:19.673054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9cd2f-45f9-4c54-9c18-ad0df1c065a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:19.673364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9cd2f-45f9-4c54-9c18-ad0df1c065a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:19.674758 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9cd2f-45f9-4c54-9c18-ad0df1c065a6 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:19.687549 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 352/713] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:19.696402 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9cd2f-45f9-4c54-9c18-ad0df1c065a6 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:19.808480 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:19.826133 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9cd2f-45f9-4c54-9c18-ad0df1c065a6 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:19.846154 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf52fe4-3b8d-4ee3-b243-98b31038248c None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:19.865127 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7a6da-ed59-49dc-9c0a-700fefe5823f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:19.865943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7a6da-ed59-49dc-9c0a-700fefe5823f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:19.866234 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7a6da-ed59-49dc-9c0a-700fefe5823f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:19.866516 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7a6da-ed59-49dc-9c0a-700fefe5823f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:19.874486 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7a6da-ed59-49dc-9c0a-700fefe5823f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:19.876147 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7a6da-ed59-49dc-9c0a-700fefe5823f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-74e7a6da-ed59-49dc-9c0a-700fefe5823f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:19.894200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:19.895134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:19.896584 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:19.896584 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:19.896584 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:19.896584 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:19.896584 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:19.896584 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:19.896584 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:19.896584 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:19.896584 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 353/714] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:19.904566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7a6da-ed59-49dc-9c0a-700fefe5823f None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:19.934418 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf0fa9-ea63-472d-bf8b-17b1d358cfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:19.935241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf0fa9-ea63-472d-bf8b-17b1d358cfb3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:19.935526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf0fa9-ea63-472d-bf8b-17b1d358cfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:19.935802 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf0fa9-ea63-472d-bf8b-17b1d358cfb3 None admin] PATH_INFO: `/v3/services/network` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:19.936493 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf0fa9-ea63-472d-bf8b-17b1d358cfb3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:19.937913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf0fa9-ea63-472d-bf8b-17b1d358cfb3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-cadf0fa9-ea63-472d-bf8b-17b1d358cfb3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:19.957996 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:19.959044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:19.961093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 362/715] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:19 2022] GET /identity/v3/services/network => generated 88 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:19.972153 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf0fa9-ea63-472d-bf8b-17b1d358cfb3 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:20.051137 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:20.120277 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf0fa9-ea63-472d-bf8b-17b1d358cfb3 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:20.158869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5f2c4-2bd6-47c5-b598-c4c53923573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:20.159474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5f2c4-2bd6-47c5-b598-c4c53923573b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:20.159771 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5f2c4-2bd6-47c5-b598-c4c53923573b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:20.160056 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5f2c4-2bd6-47c5-b598-c4c53923573b None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:20.160819 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5f2c4-2bd6-47c5-b598-c4c53923573b None admin] RBAC: Adding query filter params (name=network) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:20.161139 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5f2c4-2bd6-47c5-b598-c4c53923573b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:20.162898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5f2c4-2bd6-47c5-b598-c4c53923573b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:20.168229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 363/716] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:41:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:20.174409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5f2c4-2bd6-47c5-b598-c4c53923573b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:20.214880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7a6da-ed59-49dc-9c0a-700fefe5823f None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:20.268874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58fc5e-4d58-4a87-aeaf-030195ada6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:20.269562 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58fc5e-4d58-4a87-aeaf-030195ada6ce None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:20.269853 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58fc5e-4d58-4a87-aeaf-030195ada6ce None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:20.270136 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58fc5e-4d58-4a87-aeaf-030195ada6ce None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:20.270965 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58fc5e-4d58-4a87-aeaf-030195ada6ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:20.271284 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58fc5e-4d58-4a87-aeaf-030195ada6ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:20.272831 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58fc5e-4d58-4a87-aeaf-030195ada6ce None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:20.286292 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 354/717] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:20.287741 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67632f0e-ebdc-4ceb-add2-eb8ebd436dbc None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:20.288037 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67632f0e-ebdc-4ceb-add2-eb8ebd436dbc None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:20.288428 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67632f0e-ebdc-4ceb-add2-eb8ebd436dbc None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:20.289991 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 355/718] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:20.292185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67632f0e-ebdc-4ceb-add2-eb8ebd436dbc None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:20.298193 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:20.319935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5f2c4-2bd6-47c5-b598-c4c53923573b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:20.361706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac58e2f-1b85-48f6-b08d-b30bc6d6a5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:20.362651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58e2f-1b85-48f6-b08d-b30bc6d6a5cf None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:20.363222 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58e2f-1b85-48f6-b08d-b30bc6d6a5cf None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:20.363657 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58e2f-1b85-48f6-b08d-b30bc6d6a5cf None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:20.364585 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac58e2f-1b85-48f6-b08d-b30bc6d6a5cf None admin] RBAC: Adding query filter params (type=network) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:20.365103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac58e2f-1b85-48f6-b08d-b30bc6d6a5cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:20.366693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac58e2f-1b85-48f6-b08d-b30bc6d6a5cf None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:20.373139 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 364/719] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:41:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:20.373461 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:20.380967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9593663-4ccf-4796-b518-903808b57385 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:20.381709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9593663-4ccf-4796-b518-903808b57385 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:20.382197 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9593663-4ccf-4796-b518-903808b57385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:20.417577 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-b9593663-4ccf-4796-b518-903808b57385 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:20.418939 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-b9593663-4ccf-4796-b518-903808b57385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:20.519187 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67632f0e-ebdc-4ceb-add2-eb8ebd436dbc None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:20.608839 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ac25a-f0a8-40c7-aa6f-d987665b0eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:20.609999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ac25a-f0a8-40c7-aa6f-d987665b0eb4 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:20.611940 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ac25a-f0a8-40c7-aa6f-d987665b0eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:20.613088 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ac25a-f0a8-40c7-aa6f-d987665b0eb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:20.614449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ac25a-f0a8-40c7-aa6f-d987665b0eb4 None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=971eae8a8ad44ce893c311b74acbd76b) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:20.614996 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ac25a-f0a8-40c7-aa6f-d987665b0eb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:20.617023 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ac25a-f0a8-40c7-aa6f-d987665b0eb4 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:20.623235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 365/720] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:20.629652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 356/721] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:20 2022] GET /identity/v3/role_assignments?user.id=971eae8a8ad44ce893c311b74acbd76b&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:20.674655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9593663-4ccf-4796-b518-903808b57385 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:20.796948 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8020c13-2458-411c-b074-512bc10a750d None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:20.797489 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8020c13-2458-411c-b074-512bc10a750d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:20.797943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8020c13-2458-411c-b074-512bc10a750d None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:20.809180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 357/722] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:20 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:20.817721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67eee3-6c50-48a8-954c-a955044a86aa None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:20.818193 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67eee3-6c50-48a8-954c-a955044a86aa None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:20.818649 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67eee3-6c50-48a8-954c-a955044a86aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:20.823675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:20.836804 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9593663-4ccf-4796-b518-903808b57385 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:20.877706 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-fb67eee3-6c50-48a8-954c-a955044a86aa None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:20.879884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-fb67eee3-6c50-48a8-954c-a955044a86aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:20.944766 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085e629-3942-44cd-80ff-5f587f5d5c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:20.945898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085e629-3942-44cd-80ff-5f587f5d5c71 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:20.948288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085e629-3942-44cd-80ff-5f587f5d5c71 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:20.954384 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085e629-3942-44cd-80ff-5f587f5d5c71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:20.977641 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085e629-3942-44cd-80ff-5f587f5d5c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-3085e629-3942-44cd-80ff-5f587f5d5c71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:20.986267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:20.987276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:20.988141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:20.988141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:20.988141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:20.988141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:20.988141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:20.988141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:20.988141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:20.988141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:20.988141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:20.988141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:20.988141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:20.988141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:21.000171 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 366/723] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:21.007693 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:21.009599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085e629-3942-44cd-80ff-5f587f5d5c71 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:21.026015 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 358/724] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:41:21.084276 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67eee3-6c50-48a8-954c-a955044a86aa None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:21.223451 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085e629-3942-44cd-80ff-5f587f5d5c71 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:21.284154 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e62766-45a2-40f1-ad18-f8cce7ddcf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:21.285242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e62766-45a2-40f1-ad18-f8cce7ddcf50 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:21.285744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e62766-45a2-40f1-ad18-f8cce7ddcf50 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:21.286234 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e62766-45a2-40f1-ad18-f8cce7ddcf50 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:21.287276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e62766-45a2-40f1-ad18-f8cce7ddcf50 None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:21.287859 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e62766-45a2-40f1-ad18-f8cce7ddcf50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:21.289627 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e62766-45a2-40f1-ad18-f8cce7ddcf50 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:21.300429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 367/725] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:21.308592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e62766-45a2-40f1-ad18-f8cce7ddcf50 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:21.319307 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67eee3-6c50-48a8-954c-a955044a86aa None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:21.336476 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:21.429669 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e62766-45a2-40f1-ad18-f8cce7ddcf50 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:21.448931 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db06f-0445-4c07-b2e1-ee10aecda87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:21.449798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db06f-0445-4c07-b2e1-ee10aecda87b None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:21.450141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db06f-0445-4c07-b2e1-ee10aecda87b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:21.450426 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db06f-0445-4c07-b2e1-ee10aecda87b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:21.474416 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446aa68e-245d-446d-844b-343b2f0440ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:21.475399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aa68e-245d-446d-844b-343b2f0440ec None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:21.475747 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aa68e-245d-446d-844b-343b2f0440ec None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:21.476027 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aa68e-245d-446d-844b-343b2f0440ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:21.489638 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3db06f-0445-4c07-b2e1-ee10aecda87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:21.499305 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446aa68e-245d-446d-844b-343b2f0440ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:21.500832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446aa68e-245d-446d-844b-343b2f0440ec None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-2c3db06f-0445-4c07-b2e1-ee10aecda87b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:21.505505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:21.506488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:21.507343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:21.507343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:21.507343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:21.507343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:21.507343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:21.507343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:21.507343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:21.507343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:21.507343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:21.507343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:21.507343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:41:21.507343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:21.508760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 359/726] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:41:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:21.522292 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db06f-0445-4c07-b2e1-ee10aecda87b None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-446aa68e-245d-446d-844b-343b2f0440ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:21.547931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:21.551349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:21.554695 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:21.554695 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:21.554695 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:21.554695 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:21.554695 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 368/727] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:21.559669 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446aa68e-245d-446d-844b-343b2f0440ec None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:21.627545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:21.669531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:21.687344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db06f-0445-4c07-b2e1-ee10aecda87b None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:21.708144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446aa68e-245d-446d-844b-343b2f0440ec None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:21.748983 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8fe27-8c10-4b3b-ab10-247cff2bdddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:21.749990 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8fe27-8c10-4b3b-ab10-247cff2bdddd None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:21.750432 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8fe27-8c10-4b3b-ab10-247cff2bdddd None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:21.750860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8fe27-8c10-4b3b-ab10-247cff2bdddd None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:21.752023 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8fe27-8c10-4b3b-ab10-247cff2bdddd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:21.752513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8fe27-8c10-4b3b-ab10-247cff2bdddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:21.753235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d320d-34c4-47b3-830b-e226bb0fb288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:21.754014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d320d-34c4-47b3-830b-e226bb0fb288 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:21.754402 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d320d-34c4-47b3-830b-e226bb0fb288 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:21.754577 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8fe27-8c10-4b3b-ab10-247cff2bdddd None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:21.754866 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d320d-34c4-47b3-830b-e226bb0fb288 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:21.755763 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d320d-34c4-47b3-830b-e226bb0fb288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:21.756253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d320d-34c4-47b3-830b-e226bb0fb288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:21.758084 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d320d-34c4-47b3-830b-e226bb0fb288 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:21.767714 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 360/728] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:41:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:21.769804 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbde121-18fb-48ad-b92c-fb4074d8d1c7 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:21.770262 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbde121-18fb-48ad-b92c-fb4074d8d1c7 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:21.770697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbde121-18fb-48ad-b92c-fb4074d8d1c7 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:21.776386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 369/729] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:21.776386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d320d-34c4-47b3-830b-e226bb0fb288 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:21.781798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 361/730] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:21.782761 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbde121-18fb-48ad-b92c-fb4074d8d1c7 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:21.901337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d320d-34c4-47b3-830b-e226bb0fb288 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:21.915899 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbde121-18fb-48ad-b92c-fb4074d8d1c7 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:21.939768 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:21.946031 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:21.956464 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66112584-f5b3-4a05-89f4-047a54c66b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:21.957270 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66112584-f5b3-4a05-89f4-047a54c66b9a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:21.957558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66112584-f5b3-4a05-89f4-047a54c66b9a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:21.957836 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66112584-f5b3-4a05-89f4-047a54c66b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:21.962178 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed876f98-03e2-495e-8b10-b7610ecbf69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:21.963875 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed876f98-03e2-495e-8b10-b7610ecbf69f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:21.964414 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed876f98-03e2-495e-8b10-b7610ecbf69f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:21.965082 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed876f98-03e2-495e-8b10-b7610ecbf69f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:21.971164 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66112584-f5b3-4a05-89f4-047a54c66b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:21.972742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66112584-f5b3-4a05-89f4-047a54c66b9a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:21.977819 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed876f98-03e2-495e-8b10-b7610ecbf69f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:21.980553 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed876f98-03e2-495e-8b10-b7610ecbf69f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-66112584-f5b3-4a05-89f4-047a54c66b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:21.994510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:21.995507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:21.996455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:21.996455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:21.996455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:21.996455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:21.996455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 370/731] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:21.997812 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76787d-1053-460b-9f99-b22709787668 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:21.998103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76787d-1053-460b-9f99-b22709787668 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:21.998387 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76787d-1053-460b-9f99-b22709787668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-ed876f98-03e2-495e-8b10-b7610ecbf69f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:22.002695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:22.003625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:22.004624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:22.004624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:22.004624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:22.004624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:22.004624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:22.004624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:22.004624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:22.004624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:22.004624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:41:22.004624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:22.010670 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 362/732] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 13:41:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:22.010670 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed876f98-03e2-495e-8b10-b7610ecbf69f None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:22.024851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-5f76787d-1053-460b-9f99-b22709787668 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:22.026627 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-5f76787d-1053-460b-9f99-b22709787668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:22.119585 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 371/733] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:22.121194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76787d-1053-460b-9f99-b22709787668 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:22.163888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed876f98-03e2-495e-8b10-b7610ecbf69f None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:22.217961 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d261209-77f3-42d4-b9b8-1dc8897f45f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:22.219059 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d261209-77f3-42d4-b9b8-1dc8897f45f8 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:22.219571 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d261209-77f3-42d4-b9b8-1dc8897f45f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:22.220057 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d261209-77f3-42d4-b9b8-1dc8897f45f8 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:22.221069 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d261209-77f3-42d4-b9b8-1dc8897f45f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:22.221594 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d261209-77f3-42d4-b9b8-1dc8897f45f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:22.223811 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d261209-77f3-42d4-b9b8-1dc8897f45f8 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:22.243268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 363/734] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:22.248998 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d261209-77f3-42d4-b9b8-1dc8897f45f8 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:22.257368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76787d-1053-460b-9f99-b22709787668 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:22.275804 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:22.300078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:22.302736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929b26-1708-47c4-9c52-cff87e19b358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:22.303681 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929b26-1708-47c4-9c52-cff87e19b358 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:22.303914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929b26-1708-47c4-9c52-cff87e19b358 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:22.304209 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929b26-1708-47c4-9c52-cff87e19b358 None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:22.305168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0929b26-1708-47c4-9c52-cff87e19b358 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:22.305572 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0929b26-1708-47c4-9c52-cff87e19b358 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:22.308009 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0929b26-1708-47c4-9c52-cff87e19b358 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:22.334674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 372/735] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 13:41:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:22.334674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929b26-1708-47c4-9c52-cff87e19b358 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:22.383075 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d261209-77f3-42d4-b9b8-1dc8897f45f8 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:22.422690 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4fbcc-1517-4c50-b772-5ef54d35e420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:22.423762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4fbcc-1517-4c50-b772-5ef54d35e420 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:22.424291 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4fbcc-1517-4c50-b772-5ef54d35e420 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:22.424778 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4fbcc-1517-4c50-b772-5ef54d35e420 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:22.425739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4fbcc-1517-4c50-b772-5ef54d35e420 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:22.427400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4fbcc-1517-4c50-b772-5ef54d35e420 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:22.449200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 364/736] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:41:22 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:41:22.450401 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4fbcc-1517-4c50-b772-5ef54d35e420 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:22.480985 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929b26-1708-47c4-9c52-cff87e19b358 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:22.576824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d4715-ded2-44d4-804e-db1a75f2f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:22.577651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d4715-ded2-44d4-804e-db1a75f2f131 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:22.577930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d4715-ded2-44d4-804e-db1a75f2f131 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:22.578202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d4715-ded2-44d4-804e-db1a75f2f131 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:22.594989 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:22.597293 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d4715-ded2-44d4-804e-db1a75f2f131 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:22.598752 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d4715-ded2-44d4-804e-db1a75f2f131 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:22.600624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4fbcc-1517-4c50-b772-5ef54d35e420 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-060d4715-ded2-44d4-804e-db1a75f2f131 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:22.629260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:22.630332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:22.631287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:22.631287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:22.631287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:22.631287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:22.631287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:22.631287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:22.631287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:22.631287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:22.631287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:41:22.631287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:22.631287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 373/737] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:41:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:22.637197 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d4715-ded2-44d4-804e-db1a75f2f131 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:22.654858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456072b6-ffba-44c8-aeed-165cb7232897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:22.656930 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456072b6-ffba-44c8-aeed-165cb7232897 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:22.657455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456072b6-ffba-44c8-aeed-165cb7232897 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:22.658083 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456072b6-ffba-44c8-aeed-165cb7232897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:22.673416 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:22.762548 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456072b6-ffba-44c8-aeed-165cb7232897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:22.764327 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456072b6-ffba-44c8-aeed-165cb7232897 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:22.783433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d4715-ded2-44d4-804e-db1a75f2f131 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:22.834528 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1858d-971c-4868-a5c6-3fb1ad02890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:22.835826 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1858d-971c-4868-a5c6-3fb1ad02890c None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:22.836777 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1858d-971c-4868-a5c6-3fb1ad02890c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:22.837402 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1858d-971c-4868-a5c6-3fb1ad02890c None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:22.839173 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1858d-971c-4868-a5c6-3fb1ad02890c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:22.839743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1858d-971c-4868-a5c6-3fb1ad02890c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:22.842462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1858d-971c-4868-a5c6-3fb1ad02890c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:22.870007 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 374/738] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 13:41:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:22.877178 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1858d-971c-4868-a5c6-3fb1ad02890c None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:22.997032 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:23.023600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1858d-971c-4868-a5c6-3fb1ad02890c None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:23.069984 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8700-d388-468f-9b86-94616c9debc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:23.070916 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8700-d388-468f-9b86-94616c9debc4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:23.071374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8700-d388-468f-9b86-94616c9debc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:23.071802 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8700-d388-468f-9b86-94616c9debc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:23.085375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:23.095817 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 365/739] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:22 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:41:23.097418 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456072b6-ffba-44c8-aeed-165cb7232897 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:23.163628 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc8700-d388-468f-9b86-94616c9debc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:23.165401 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc8700-d388-468f-9b86-94616c9debc4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:23.280793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456072b6-ffba-44c8-aeed-165cb7232897 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:23.323623 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621aef5-b44c-47ae-8849-00e45d0290d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:23.324874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621aef5-b44c-47ae-8849-00e45d0290d0 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:23.325317 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621aef5-b44c-47ae-8849-00e45d0290d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:23.326306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621aef5-b44c-47ae-8849-00e45d0290d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:23.339785 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621aef5-b44c-47ae-8849-00e45d0290d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:23.341626 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621aef5-b44c-47ae-8849-00e45d0290d0 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-0621aef5-b44c-47ae-8849-00e45d0290d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:23.362445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:23.363404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:23.364338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:23.364338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:23.364338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:23.364338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:23.364562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:23.367556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 366/740] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:23.375862 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621aef5-b44c-47ae-8849-00e45d0290d0 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:23.403175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 375/741] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:22 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:41:23.406753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8700-d388-468f-9b86-94616c9debc4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:23.477280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:23.566394 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8700-d388-468f-9b86-94616c9debc4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:23.611508 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621aef5-b44c-47ae-8849-00e45d0290d0 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:23.625241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc268b04-1183-43ea-ad3d-d62ae4ed6bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:23.626446 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc268b04-1183-43ea-ad3d-d62ae4ed6bd0 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:23.626947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc268b04-1183-43ea-ad3d-d62ae4ed6bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:23.627434 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc268b04-1183-43ea-ad3d-d62ae4ed6bd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:23.641116 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc268b04-1183-43ea-ad3d-d62ae4ed6bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:23.643187 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc268b04-1183-43ea-ad3d-d62ae4ed6bd0 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-dc268b04-1183-43ea-ad3d-d62ae4ed6bd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:23.664376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:23.665393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:23.666885 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:23.666885 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:23.666885 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:23.666885 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:23.674005 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 376/742] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:23.676158 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064bcd9-c96f-4021-8a79-19fde3024b10 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:23.676694 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064bcd9-c96f-4021-8a79-19fde3024b10 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:23.677231 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064bcd9-c96f-4021-8a79-19fde3024b10 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:23.679473 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46833c-646b-43fc-9c20-c7dd00665caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:23.679852 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 377/743] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:23.680866 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064bcd9-c96f-4021-8a79-19fde3024b10 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:23.688009 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46833c-646b-43fc-9c20-c7dd00665caa None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:23.688618 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46833c-646b-43fc-9c20-c7dd00665caa None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:23.689123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46833c-646b-43fc-9c20-c7dd00665caa None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:23.690593 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46833c-646b-43fc-9c20-c7dd00665caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:23.691161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46833c-646b-43fc-9c20-c7dd00665caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:23.693911 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46833c-646b-43fc-9c20-c7dd00665caa None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:23.720629 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 367/744] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:23.721182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2e9a2-e569-4d3e-b714-6623d43b4e01 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:23.721697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2e9a2-e569-4d3e-b714-6623d43b4e01 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:23.722198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2e9a2-e569-4d3e-b714-6623d43b4e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:23.746984 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:23.752050 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-61b2e9a2-e569-4d3e-b714-6623d43b4e01 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:23.754096 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-61b2e9a2-e569-4d3e-b714-6623d43b4e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:23.828981 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064bcd9-c96f-4021-8a79-19fde3024b10 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:23.844199 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 368/745] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:23.844199 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f414b4-4b27-4b87-a5b7-58e67e01f45c None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:23.844494 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f414b4-4b27-4b87-a5b7-58e67e01f45c None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:23.844867 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f414b4-4b27-4b87-a5b7-58e67e01f45c None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:23.848632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 369/746] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:23.850656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f414b4-4b27-4b87-a5b7-58e67e01f45c None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:23.896532 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bb43b-9f83-4807-82f8-978dfe6bf1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:23.897621 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bb43b-9f83-4807-82f8-978dfe6bf1a8 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:23.898125 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bb43b-9f83-4807-82f8-978dfe6bf1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:23.898634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bb43b-9f83-4807-82f8-978dfe6bf1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:23.900178 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bb43b-9f83-4807-82f8-978dfe6bf1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:23.901271 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bb43b-9f83-4807-82f8-978dfe6bf1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:23.904384 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bb43b-9f83-4807-82f8-978dfe6bf1a8 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:23.923202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 378/747] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:23.925324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e22b-066a-4571-bb08-cf76b6c03c7f None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:23.925806 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e22b-066a-4571-bb08-cf76b6c03c7f None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:23.926285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e22b-066a-4571-bb08-cf76b6c03c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:23.946810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:23.957886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-d5d1e22b-066a-4571-bb08-cf76b6c03c7f None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:23.960087 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-d5d1e22b-066a-4571-bb08-cf76b6c03c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:24.054739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f414b4-4b27-4b87-a5b7-58e67e01f45c None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:24.100267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 379/748] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:41:24.100267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e22b-066a-4571-bb08-cf76b6c03c7f None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:24.127439 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac73e51-9780-4335-8d81-094029cd212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:24.128896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac73e51-9780-4335-8d81-094029cd212d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:24.129441 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac73e51-9780-4335-8d81-094029cd212d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:24.130460 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac73e51-9780-4335-8d81-094029cd212d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:24.144344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac73e51-9780-4335-8d81-094029cd212d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:24.146927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac73e51-9780-4335-8d81-094029cd212d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:24.154488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-cac73e51-9780-4335-8d81-094029cd212d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:24.171094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:24.172696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:24.181038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:24.181038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:24.181038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:24.181038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:24.181038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:24.181038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:24.181038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:24.181038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:24.181038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 370/749] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:24.181038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac73e51-9780-4335-8d81-094029cd212d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:24.291658 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e22b-066a-4571-bb08-cf76b6c03c7f None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:24.333938 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac73e51-9780-4335-8d81-094029cd212d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:24.336181 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:24.338665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf20ce-2ef4-4f39-8d1f-5ca17c3656e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:24.339503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf20ce-2ef4-4f39-8d1f-5ca17c3656e4 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:24.339867 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf20ce-2ef4-4f39-8d1f-5ca17c3656e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:24.340035 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf20ce-2ef4-4f39-8d1f-5ca17c3656e4 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:24.340897 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf20ce-2ef4-4f39-8d1f-5ca17c3656e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:24.342628 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf20ce-2ef4-4f39-8d1f-5ca17c3656e4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:24.361760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 380/750] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:41:24 2022] POST /identity/v3/services => generated 240 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:41:24.362642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf20ce-2ef4-4f39-8d1f-5ca17c3656e4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:24.419575 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961415-a1c8-418d-8918-928dd4258c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:24.420353 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961415-a1c8-418d-8918-928dd4258c32 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:24.420637 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961415-a1c8-418d-8918-928dd4258c32 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:24.420914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961415-a1c8-418d-8918-928dd4258c32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:24.429652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51961415-a1c8-418d-8918-928dd4258c32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:24.431202 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51961415-a1c8-418d-8918-928dd4258c32 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-51961415-a1c8-418d-8918-928dd4258c32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:24.448588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:24.449621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:24.450543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:24.450543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:24.450543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:24.450543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:24.450543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:24.450543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:24.450543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:24.450543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:24.455002 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 371/751] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:24.456022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961415-a1c8-418d-8918-928dd4258c32 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:24.518965 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:24.544301 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf20ce-2ef4-4f39-8d1f-5ca17c3656e4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:24.604877 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e51b6c-7107-433e-ab79-356db83c4f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:24.607136 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e51b6c-7107-433e-ab79-356db83c4f58 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:24.608080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e51b6c-7107-433e-ab79-356db83c4f58 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:24.608605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e51b6c-7107-433e-ab79-356db83c4f58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:24.618624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961415-a1c8-418d-8918-928dd4258c32 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:24.626963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e51b6c-7107-433e-ab79-356db83c4f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-e3e51b6c-7107-433e-ab79-356db83c4f58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:24.638838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:24.644931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:24.645809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:24.645809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:24.645809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:24.645809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:24.645809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:24.645809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:24.645809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:24.645809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:24.645809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:24.645809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:24.645809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:41:24.645809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:24.651215 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 381/752] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:41:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:24.651215 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e51b6c-7107-433e-ab79-356db83c4f58 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:24.680569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d2c34-7816-4fe0-ac69-3776d81e2c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:24.682777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d2c34-7816-4fe0-ac69-3776d81e2c05 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:24.682777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d2c34-7816-4fe0-ac69-3776d81e2c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:24.683243 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d2c34-7816-4fe0-ac69-3776d81e2c05 None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:24.686517 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d2c34-7816-4fe0-ac69-3776d81e2c05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:24.686517 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d2c34-7816-4fe0-ac69-3776d81e2c05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:24.688502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d2c34-7816-4fe0-ac69-3776d81e2c05 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:24.717251 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 372/753] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:24.720829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d2c34-7816-4fe0-ac69-3776d81e2c05 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:24.753163 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:24.812804 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e51b6c-7107-433e-ab79-356db83c4f58 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:24.851456 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0788e7-4780-4fd5-9bc2-d0d307c06108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:24.852206 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0788e7-4780-4fd5-9bc2-d0d307c06108 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:24.852500 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0788e7-4780-4fd5-9bc2-d0d307c06108 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:24.852771 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0788e7-4780-4fd5-9bc2-d0d307c06108 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:24.853619 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0788e7-4780-4fd5-9bc2-d0d307c06108 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:24.853922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0788e7-4780-4fd5-9bc2-d0d307c06108 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:24.855435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0788e7-4780-4fd5-9bc2-d0d307c06108 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:24.871071 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d2c34-7816-4fe0-ac69-3776d81e2c05 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:24.871459 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 382/754] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:24.872352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0788e7-4780-4fd5-9bc2-d0d307c06108 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:24.890321 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:24.915835 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b16a83-33ba-47f9-9246-fb8524957525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:24.917076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b16a83-33ba-47f9-9246-fb8524957525 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:24.917668 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b16a83-33ba-47f9-9246-fb8524957525 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:24.918152 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b16a83-33ba-47f9-9246-fb8524957525 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:24.919157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b16a83-33ba-47f9-9246-fb8524957525 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:24.919685 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b16a83-33ba-47f9-9246-fb8524957525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:24.921330 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b16a83-33ba-47f9-9246-fb8524957525 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:24.936694 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 373/755] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:41:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:24.937961 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b16a83-33ba-47f9-9246-fb8524957525 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:24.990567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0788e7-4780-4fd5-9bc2-d0d307c06108 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:25.029897 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011998-ec9a-4c53-9e35-7f4e5b37a231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:25.030570 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011998-ec9a-4c53-9e35-7f4e5b37a231 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:25.030896 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011998-ec9a-4c53-9e35-7f4e5b37a231 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:25.031178 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011998-ec9a-4c53-9e35-7f4e5b37a231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:25.032030 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b011998-ec9a-4c53-9e35-7f4e5b37a231 None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=b1e5039385f44bb2b52e795524d6b8d2) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:25.032385 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b011998-ec9a-4c53-9e35-7f4e5b37a231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:25.033935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b011998-ec9a-4c53-9e35-7f4e5b37a231 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:25.042107 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:25.044798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 383/756] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:24 2022] GET /identity/v3/role_assignments?user.id=b1e5039385f44bb2b52e795524d6b8d2&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:25.045871 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011998-ec9a-4c53-9e35-7f4e5b37a231 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:25.070144 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b16a83-33ba-47f9-9246-fb8524957525 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:25.116894 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884f49d-df96-4555-9964-42664967149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:25.118074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884f49d-df96-4555-9964-42664967149c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:25.118681 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884f49d-df96-4555-9964-42664967149c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:25.119292 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884f49d-df96-4555-9964-42664967149c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:25.120724 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884f49d-df96-4555-9964-42664967149c None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=41c94d4eb019422fbea20bba97fa77a4) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:25.121425 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884f49d-df96-4555-9964-42664967149c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:25.123457 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884f49d-df96-4555-9964-42664967149c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:25.131856 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 374/757] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:24 2022] GET /identity/v3/role_assignments?user.id=41c94d4eb019422fbea20bba97fa77a4&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:25.238558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:25.301126 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011998-ec9a-4c53-9e35-7f4e5b37a231 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:25.404508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93473cbe-65cc-4ceb-bb66-44581b39a09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:25.405854 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473cbe-65cc-4ceb-bb66-44581b39a09b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:25.406298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473cbe-65cc-4ceb-bb66-44581b39a09b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:25.406765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473cbe-65cc-4ceb-bb66-44581b39a09b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:25.434000 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93473cbe-65cc-4ceb-bb66-44581b39a09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:25.436988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93473cbe-65cc-4ceb-bb66-44581b39a09b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-93473cbe-65cc-4ceb-bb66-44581b39a09b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:25.479487 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:25.480626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:25.481539 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:25.481539 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:25.481539 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:25.481539 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:25.490609 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 384/758] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:25.497955 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884f49d-df96-4555-9964-42664967149c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:25.825923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884f49d-df96-4555-9964-42664967149c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:25.895165 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2c29a-8079-48cd-bfc3-7dfce43ef8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:25.896327 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2c29a-8079-48cd-bfc3-7dfce43ef8f2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:25.896771 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2c29a-8079-48cd-bfc3-7dfce43ef8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:25.897223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2c29a-8079-48cd-bfc3-7dfce43ef8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:25.898593 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2c29a-8079-48cd-bfc3-7dfce43ef8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:25.899150 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2c29a-8079-48cd-bfc3-7dfce43ef8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:25.902420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2c29a-8079-48cd-bfc3-7dfce43ef8f2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:25.931154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 375/759] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:25.931350 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93473cbe-65cc-4ceb-bb66-44581b39a09b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:26.144914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93473cbe-65cc-4ceb-bb66-44581b39a09b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:26.191220 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:26.209878 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f77ec-b5aa-4ad1-b398-f1c63b09749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:26.210888 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f77ec-b5aa-4ad1-b398-f1c63b09749c None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:26.211321 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f77ec-b5aa-4ad1-b398-f1c63b09749c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:26.211566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f77ec-b5aa-4ad1-b398-f1c63b09749c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:26.229806 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f77ec-b5aa-4ad1-b398-f1c63b09749c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:26.231768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f77ec-b5aa-4ad1-b398-f1c63b09749c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-b67f77ec-b5aa-4ad1-b398-f1c63b09749c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:26.251547 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:26.252711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:26.253749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:26.253749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:26.253749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:26.253749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:26.253749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:26.253749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:26.253749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:26.253749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:26.253749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:41:26.253749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:26.258712 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 385/760] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 13:41:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:26.260960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2c29a-8079-48cd-bfc3-7dfce43ef8f2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:26.266902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc3e82-c0c9-4e42-b7bd-ef13e6d9efc2 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:26.266902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc3e82-c0c9-4e42-b7bd-ef13e6d9efc2 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:26.267298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc3e82-c0c9-4e42-b7bd-ef13e6d9efc2 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:26.271283 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:26.271567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 386/761] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:41:26.301833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251a3c1-e4f3-437d-9ff9-49dfb5d9e4d1 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:26.302167 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251a3c1-e4f3-437d-9ff9-49dfb5d9e4d1 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:26.302409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251a3c1-e4f3-437d-9ff9-49dfb5d9e4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:26.332615 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-b251a3c1-e4f3-437d-9ff9-49dfb5d9e4d1 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:26.335638 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-b251a3c1-e4f3-437d-9ff9-49dfb5d9e4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:26.435856 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2c29a-8079-48cd-bfc3-7dfce43ef8f2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:26.481915 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 387/762] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:26.496953 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421705-04cb-4f53-a68c-1e60e35edecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:26.498011 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421705-04cb-4f53-a68c-1e60e35edecd None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:26.498528 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421705-04cb-4f53-a68c-1e60e35edecd None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:26.498960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421705-04cb-4f53-a68c-1e60e35edecd None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:26.500477 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36421705-04cb-4f53-a68c-1e60e35edecd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:26.501031 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36421705-04cb-4f53-a68c-1e60e35edecd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:26.503550 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36421705-04cb-4f53-a68c-1e60e35edecd None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:26.553950 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 376/763] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 13:41:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:26.562650 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251a3c1-e4f3-437d-9ff9-49dfb5d9e4d1 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:26.579207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421705-04cb-4f53-a68c-1e60e35edecd None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:26.714026 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251a3c1-e4f3-437d-9ff9-49dfb5d9e4d1 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:26.717592 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:26.732411 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:26.768893 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec7f4a-bf2f-438b-8c6b-8b9da9f79367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:26.769920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec7f4a-bf2f-438b-8c6b-8b9da9f79367 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:26.770379 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec7f4a-bf2f-438b-8c6b-8b9da9f79367 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:26.770760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec7f4a-bf2f-438b-8c6b-8b9da9f79367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:26.789017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec7f4a-bf2f-438b-8c6b-8b9da9f79367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:26.791245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec7f4a-bf2f-438b-8c6b-8b9da9f79367 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:26.798422 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421705-04cb-4f53-a68c-1e60e35edecd None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-edec7f4a-bf2f-438b-8c6b-8b9da9f79367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:26.832039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:26.833243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:26.834439 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:26.834439 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:26.834439 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:26.834439 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:26.847099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 388/764] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:26.849210 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec7f4a-bf2f-438b-8c6b-8b9da9f79367 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:26.856377 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf023d-6942-4d9a-9424-d9d45330c626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:26.857909 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf023d-6942-4d9a-9424-d9d45330c626 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:26.863987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf023d-6942-4d9a-9424-d9d45330c626 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:26.864563 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf023d-6942-4d9a-9424-d9d45330c626 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:26.865583 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf023d-6942-4d9a-9424-d9d45330c626 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:26.867457 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf023d-6942-4d9a-9424-d9d45330c626 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-d9bf023d-6942-4d9a-9424-d9d45330c626 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:26.888322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:26.889682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:41:26.890884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:26.893966 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 377/765] 10.222.0.24 () {56 vars in 1129 bytes} [Wed May 25 13:41:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:26.902359 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf023d-6942-4d9a-9424-d9d45330c626 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:27.086394 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec7f4a-bf2f-438b-8c6b-8b9da9f79367 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:27.155085 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf023d-6942-4d9a-9424-d9d45330c626 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:27.182617 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75563c4f-b668-4554-8e18-f0d80725d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:27.183490 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75563c4f-b668-4554-8e18-f0d80725d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:27.183784 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75563c4f-b668-4554-8e18-f0d80725d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:27.184257 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75563c4f-b668-4554-8e18-f0d80725d5b2 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:27.185410 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75563c4f-b668-4554-8e18-f0d80725d5b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:27.185778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75563c4f-b668-4554-8e18-f0d80725d5b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:27.187745 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75563c4f-b668-4554-8e18-f0d80725d5b2 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:27.195343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:27.216558 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efdff4-a4e2-4db8-b71a-fe4255c034a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:27.217717 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdff4-a4e2-4db8-b71a-fe4255c034a7 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:27.218227 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 389/766] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:27.218490 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdff4-a4e2-4db8-b71a-fe4255c034a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:27.219019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdff4-a4e2-4db8-b71a-fe4255c034a7 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:27.219999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efdff4-a4e2-4db8-b71a-fe4255c034a7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:27.220637 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efdff4-a4e2-4db8-b71a-fe4255c034a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:27.222366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efdff4-a4e2-4db8-b71a-fe4255c034a7 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:27.228216 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75563c4f-b668-4554-8e18-f0d80725d5b2 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:27.237164 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 378/767] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 13:41:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:27.243109 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efdff4-a4e2-4db8-b71a-fe4255c034a7 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:27.278583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:27.387772 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75563c4f-b668-4554-8e18-f0d80725d5b2 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:27.454211 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d6513-9706-4d5d-ac0c-380a7711bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:27.455512 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d6513-9706-4d5d-ac0c-380a7711bb5b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:27.455980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d6513-9706-4d5d-ac0c-380a7711bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:27.456474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d6513-9706-4d5d-ac0c-380a7711bb5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:27.469615 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d6513-9706-4d5d-ac0c-380a7711bb5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:27.472414 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d6513-9706-4d5d-ac0c-380a7711bb5b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-d61d6513-9706-4d5d-ac0c-380a7711bb5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:27.501586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:27.503303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:27.506488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:27.506488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:27.506488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:27.506488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:27.506488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:27.506488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:27.506488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:27.506488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:27.506488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 390/768] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:27.514123 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d6513-9706-4d5d-ac0c-380a7711bb5b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:27.572688 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efdff4-a4e2-4db8-b71a-fe4255c034a7 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:27.677339 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:27.708071 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d6513-9706-4d5d-ac0c-380a7711bb5b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:27.713762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348572f-9d7c-4657-bd6d-bc30441e4378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:27.714849 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348572f-9d7c-4657-bd6d-bc30441e4378 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:27.715318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348572f-9d7c-4657-bd6d-bc30441e4378 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:27.715775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348572f-9d7c-4657-bd6d-bc30441e4378 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:27.717203 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348572f-9d7c-4657-bd6d-bc30441e4378 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:27.717797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348572f-9d7c-4657-bd6d-bc30441e4378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:27.720423 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348572f-9d7c-4657-bd6d-bc30441e4378 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:27.760976 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 379/769] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 13:41:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:27.768285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348572f-9d7c-4657-bd6d-bc30441e4378 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:27.775992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d17bf-5249-4a6a-ab62-358d4fc58cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:27.776851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d17bf-5249-4a6a-ab62-358d4fc58cb8 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:27.780897 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d17bf-5249-4a6a-ab62-358d4fc58cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:27.781676 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d17bf-5249-4a6a-ab62-358d4fc58cb8 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:27.785455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d17bf-5249-4a6a-ab62-358d4fc58cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:27.785455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d17bf-5249-4a6a-ab62-358d4fc58cb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:27.786778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d17bf-5249-4a6a-ab62-358d4fc58cb8 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:27.819183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 391/770] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:27.829503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d17bf-5249-4a6a-ab62-358d4fc58cb8 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:27.906818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:27.987225 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348572f-9d7c-4657-bd6d-bc30441e4378 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:28.036426 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea22f2-43d0-442a-afcf-240e689b67d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:28.037247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea22f2-43d0-442a-afcf-240e689b67d0 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:28.037763 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea22f2-43d0-442a-afcf-240e689b67d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:28.038048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea22f2-43d0-442a-afcf-240e689b67d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:28.039106 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea22f2-43d0-442a-afcf-240e689b67d0 None admin] RBAC: Adding query filter params (interface=public, service_id=a62e302189bf4a6ea1af44260bf93002, region_id=RegionOne) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:28.039473 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea22f2-43d0-442a-afcf-240e689b67d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:28.042155 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea22f2-43d0-442a-afcf-240e689b67d0 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:28.053670 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 380/771] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 13:41:27 2022] GET /identity/v3/endpoints?service_id=a62e302189bf4a6ea1af44260bf93002&interface=public®ion_id=RegionOne => generated 194 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:28.059301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea22f2-43d0-442a-afcf-240e689b67d0 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:28.098130 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d17bf-5249-4a6a-ab62-358d4fc58cb8 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:28.141164 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee83d9e-0d5e-4725-b684-28de74f8a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:28.142196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee83d9e-0d5e-4725-b684-28de74f8a62a None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:28.142408 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee83d9e-0d5e-4725-b684-28de74f8a62a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:28.142715 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee83d9e-0d5e-4725-b684-28de74f8a62a None admin] PATH_INFO: `/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/971eae8a8ad44ce893c311b74acbd76b/roles/109ea861e27e4d75bec3ac9c5f81096e` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:28.144882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee83d9e-0d5e-4725-b684-28de74f8a62a None admin] RBAC: Authorizing `identity:create_grant(project_id=b57fe974dc4d4542a1dd930fc6912d39, user_id=971eae8a8ad44ce893c311b74acbd76b, role_id=109ea861e27e4d75bec3ac9c5f81096e)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:28.146609 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee83d9e-0d5e-4725-b684-28de74f8a62a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:28.163568 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 392/772] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:41:27 2022] PUT /identity/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/971eae8a8ad44ce893c311b74acbd76b/roles/109ea861e27e4d75bec3ac9c5f81096e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:41:28.165184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ae2b2-63af-4402-a24c-e7112513c563 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:28.165486 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ae2b2-63af-4402-a24c-e7112513c563 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:28.166388 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ae2b2-63af-4402-a24c-e7112513c563 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:28.172610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 393/773] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:28.174244 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174df1b-4984-4fba-91ed-de6e138e795b None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:28.174844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174df1b-4984-4fba-91ed-de6e138e795b None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:28.175023 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174df1b-4984-4fba-91ed-de6e138e795b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:28.196555 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:28.198556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-0174df1b-4984-4fba-91ed-de6e138e795b None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:28.200717 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-0174df1b-4984-4fba-91ed-de6e138e795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:28.275203 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea22f2-43d0-442a-afcf-240e689b67d0 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:28.294873 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 394/774] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:28.322593 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174df1b-4984-4fba-91ed-de6e138e795b None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:28.341955 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:28.401915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4283b3c-4ff1-4307-bd90-88d4b37073bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:28.403111 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4283b3c-4ff1-4307-bd90-88d4b37073bd None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:28.403966 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4283b3c-4ff1-4307-bd90-88d4b37073bd None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:28.404147 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4283b3c-4ff1-4307-bd90-88d4b37073bd None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:28.405556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4283b3c-4ff1-4307-bd90-88d4b37073bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:28.408554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4283b3c-4ff1-4307-bd90-88d4b37073bd None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:28.432846 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 381/775] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 13:41:28 2022] GET /identity/v3/services => generated 772 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:28.509416 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174df1b-4984-4fba-91ed-de6e138e795b None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:28.584245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0932120-db90-4b71-8f5a-e5e1a14122e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:28.584976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932120-db90-4b71-8f5a-e5e1a14122e3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:28.585260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932120-db90-4b71-8f5a-e5e1a14122e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:28.585545 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932120-db90-4b71-8f5a-e5e1a14122e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:28.586232 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932120-db90-4b71-8f5a-e5e1a14122e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:28.587778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932120-db90-4b71-8f5a-e5e1a14122e3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:28.595365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-e0932120-db90-4b71-8f5a-e5e1a14122e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:28.606949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:28.609142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:41:28.610964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:28.616682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 395/776] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:28 2022] GET /identity/v3/services/network => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:28.626980 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4283b3c-4ff1-4307-bd90-88d4b37073bd None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:28.791500 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1d9c-a372-4597-bd77-5128bbcdba67 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:28.791500 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1d9c-a372-4597-bd77-5128bbcdba67 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:28.791500 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1d9c-a372-4597-bd77-5128bbcdba67 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:28.791500 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 396/777] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:28.798286 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd16e4-a995-4ac7-bbfb-dabd1056c797 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:28.798583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd16e4-a995-4ac7-bbfb-dabd1056c797 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:28.798915 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd16e4-a995-4ac7-bbfb-dabd1056c797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:28.824365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-f5fd16e4-a995-4ac7-bbfb-dabd1056c797 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:28.825631 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-f5fd16e4-a995-4ac7-bbfb-dabd1056c797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:28.889971 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4283b3c-4ff1-4307-bd90-88d4b37073bd None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:28.944334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 397/778] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:41:28.971744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd16e4-a995-4ac7-bbfb-dabd1056c797 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:28.981673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe166a09-2589-40ac-848c-e2c3e0ecf3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:28.982499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe166a09-2589-40ac-848c-e2c3e0ecf3a2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:28.982787 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe166a09-2589-40ac-848c-e2c3e0ecf3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:28.983064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe166a09-2589-40ac-848c-e2c3e0ecf3a2 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:28.983904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe166a09-2589-40ac-848c-e2c3e0ecf3a2 None admin] RBAC: Adding query filter params (name=network) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:28.984245 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe166a09-2589-40ac-848c-e2c3e0ecf3a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:28.985647 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe166a09-2589-40ac-848c-e2c3e0ecf3a2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:28.991960 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 382/779] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:41:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:29.005470 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe166a09-2589-40ac-848c-e2c3e0ecf3a2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:29.138457 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:29.163930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd16e4-a995-4ac7-bbfb-dabd1056c797 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:29.208546 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:29.223563 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15b6ab-1728-49c0-99fb-b883fcbd23bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:29.226664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15b6ab-1728-49c0-99fb-b883fcbd23bc None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:29.236915 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15b6ab-1728-49c0-99fb-b883fcbd23bc None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:29.237779 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15b6ab-1728-49c0-99fb-b883fcbd23bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:29.254092 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe166a09-2589-40ac-848c-e2c3e0ecf3a2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:29.281022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15b6ab-1728-49c0-99fb-b883fcbd23bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-ab15b6ab-1728-49c0-99fb-b883fcbd23bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:29.295457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:29.297103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:29.298616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:29.298616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:29.298616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:29.298616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:29.298616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:29.298616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:29.298616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:29.298616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:29.298616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:29.298616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:29.298616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:29.298616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:29.303741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 398/780] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:29.306932 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2711cd-04f6-41a1-85ba-ee26e7566b5a None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:29.307816 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2711cd-04f6-41a1-85ba-ee26e7566b5a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:29.308578 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2711cd-04f6-41a1-85ba-ee26e7566b5a None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:29.312022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 399/781] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:29.317528 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2711cd-04f6-41a1-85ba-ee26e7566b5a None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:29.321055 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dc26a-50df-4294-96dd-2f19594e5e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:29.323086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc26a-50df-4294-96dd-2f19594e5e96 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:29.323650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc26a-50df-4294-96dd-2f19594e5e96 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:29.324165 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc26a-50df-4294-96dd-2f19594e5e96 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:29.325220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dc26a-50df-4294-96dd-2f19594e5e96 None admin] RBAC: Adding query filter params (type=network) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:29.325762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dc26a-50df-4294-96dd-2f19594e5e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:29.327473 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dc26a-50df-4294-96dd-2f19594e5e96 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:29.334299 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 383/782] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:41:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:29.336269 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f527c8-147e-435b-a983-f9e0a760e9c5 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:29.336898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f527c8-147e-435b-a983-f9e0a760e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:29.337476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f527c8-147e-435b-a983-f9e0a760e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:29.357530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-69f527c8-147e-435b-a983-f9e0a760e9c5 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:29.359520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-69f527c8-147e-435b-a983-f9e0a760e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:29.474229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2711cd-04f6-41a1-85ba-ee26e7566b5a None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:29.483242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 384/783] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:29.485054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f527c8-147e-435b-a983-f9e0a760e9c5 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:29.551140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb5946-4c4b-4507-abd5-4a638bd08cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:29.552636 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb5946-4c4b-4507-abd5-4a638bd08cea None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:29.553244 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb5946-4c4b-4507-abd5-4a638bd08cea None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:29.553948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb5946-4c4b-4507-abd5-4a638bd08cea None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:29.555023 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb5946-4c4b-4507-abd5-4a638bd08cea None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:29.555660 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb5946-4c4b-4507-abd5-4a638bd08cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:29.559549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb5946-4c4b-4507-abd5-4a638bd08cea None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:29.577092 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 400/784] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:29.578786 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb5946-4c4b-4507-abd5-4a638bd08cea None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:29.581844 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:29.654674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:29.669405 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f527c8-147e-435b-a983-f9e0a760e9c5 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:29.720859 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885af677-9c4c-4e72-a57b-0d8f96b6587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:29.722069 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885af677-9c4c-4e72-a57b-0d8f96b6587a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:29.722564 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885af677-9c4c-4e72-a57b-0d8f96b6587a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:29.723115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885af677-9c4c-4e72-a57b-0d8f96b6587a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:29.724497 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885af677-9c4c-4e72-a57b-0d8f96b6587a None admin] RBAC: Adding query filter params (interface=public, service_id=31e55a126cd04217a6b420d90b3a3bca, region_id=RegionOne) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:29.725302 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885af677-9c4c-4e72-a57b-0d8f96b6587a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:29.726918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885af677-9c4c-4e72-a57b-0d8f96b6587a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:29.732211 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb5946-4c4b-4507-abd5-4a638bd08cea None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:29.735892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 385/785] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 13:41:29 2022] GET /identity/v3/endpoints?service_id=31e55a126cd04217a6b420d90b3a3bca&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:29.737338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885af677-9c4c-4e72-a57b-0d8f96b6587a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:29.779804 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06312d-f8a6-454c-a2a6-32e1365bd26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:29.780942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06312d-f8a6-454c-a2a6-32e1365bd26a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:29.781234 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06312d-f8a6-454c-a2a6-32e1365bd26a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:29.781515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06312d-f8a6-454c-a2a6-32e1365bd26a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:29.797249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06312d-f8a6-454c-a2a6-32e1365bd26a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-3f06312d-f8a6-454c-a2a6-32e1365bd26a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:29.807432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:29.817485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 401/786] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:41:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:29.819374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06312d-f8a6-454c-a2a6-32e1365bd26a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:29.919766 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885af677-9c4c-4e72-a57b-0d8f96b6587a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:29.924442 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:29.970189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b648d8-4b04-4696-bb0a-774f24e5ac46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:29.971686 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b648d8-4b04-4696-bb0a-774f24e5ac46 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:29.972458 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b648d8-4b04-4696-bb0a-774f24e5ac46 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:29.972982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b648d8-4b04-4696-bb0a-774f24e5ac46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:29.979558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06312d-f8a6-454c-a2a6-32e1365bd26a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:29.988530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b648d8-4b04-4696-bb0a-774f24e5ac46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:29.990523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b648d8-4b04-4696-bb0a-774f24e5ac46 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:30.007040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-a1b648d8-4b04-4696-bb0a-774f24e5ac46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:30.021926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:30.023247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:30.024683 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:30.024683 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:30.024683 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:30.024683 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:30.032285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 386/787] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:30.033085 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453c32b-d5bd-4581-a70d-794addc16b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:30.033791 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453c32b-d5bd-4581-a70d-794addc16b54 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:30.034152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453c32b-d5bd-4581-a70d-794addc16b54 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:30.034421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453c32b-d5bd-4581-a70d-794addc16b54 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:30.035134 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453c32b-d5bd-4581-a70d-794addc16b54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:30.035720 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b648d8-4b04-4696-bb0a-774f24e5ac46 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:30.036933 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453c32b-d5bd-4581-a70d-794addc16b54 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:30.043725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 402/788] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 13:41:29 2022] GET /identity/v3/services => generated 772 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:30.045655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453c32b-d5bd-4581-a70d-794addc16b54 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:30.269439 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453c32b-d5bd-4581-a70d-794addc16b54 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:30.324100 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af520b-f3c8-40c6-8305-3717debfe147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:30.325278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af520b-f3c8-40c6-8305-3717debfe147 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:30.325778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af520b-f3c8-40c6-8305-3717debfe147 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:30.326163 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b648d8-4b04-4696-bb0a-774f24e5ac46 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:30.326283 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af520b-f3c8-40c6-8305-3717debfe147 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:30.327658 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af520b-f3c8-40c6-8305-3717debfe147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:30.328244 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af520b-f3c8-40c6-8305-3717debfe147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:30.332776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af520b-f3c8-40c6-8305-3717debfe147 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:30.368141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 403/789] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:30.372205 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af520b-f3c8-40c6-8305-3717debfe147 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:30.394518 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc944e56-904f-4d09-896b-2410bcabe1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:30.395626 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc944e56-904f-4d09-896b-2410bcabe1ff None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:30.396148 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc944e56-904f-4d09-896b-2410bcabe1ff None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:30.396646 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc944e56-904f-4d09-896b-2410bcabe1ff None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:30.397879 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc944e56-904f-4d09-896b-2410bcabe1ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:30.398407 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc944e56-904f-4d09-896b-2410bcabe1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:30.401552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc944e56-904f-4d09-896b-2410bcabe1ff None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:30.416680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 387/790] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:41:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:30.419847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc944e56-904f-4d09-896b-2410bcabe1ff None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:30.442379 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:30.448672 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:30.564195 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc944e56-904f-4d09-896b-2410bcabe1ff None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:30.595107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af520b-f3c8-40c6-8305-3717debfe147 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:30.610140 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc4736-5498-4d7e-9838-091fadca18bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:30.611681 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc4736-5498-4d7e-9838-091fadca18bb None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:30.612203 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc4736-5498-4d7e-9838-091fadca18bb None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:30.612765 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc4736-5498-4d7e-9838-091fadca18bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:30.627861 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc4736-5498-4d7e-9838-091fadca18bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:30.630122 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc4736-5498-4d7e-9838-091fadca18bb None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-cafc4736-5498-4d7e-9838-091fadca18bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:30.653268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:30.654222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:30.655111 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:30.655111 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:30.655111 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:30.655111 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:30.662176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 388/791] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:30.666246 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc4736-5498-4d7e-9838-091fadca18bb None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:30.667850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c2de-c07d-44f3-99e7-5afc575c38ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:30.669124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c2de-c07d-44f3-99e7-5afc575c38ef None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:30.669680 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c2de-c07d-44f3-99e7-5afc575c38ef None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:30.670198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c2de-c07d-44f3-99e7-5afc575c38ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:30.704401 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9c2de-c07d-44f3-99e7-5afc575c38ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:30.707110 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9c2de-c07d-44f3-99e7-5afc575c38ef None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-66e9c2de-c07d-44f3-99e7-5afc575c38ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:30.771390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:30.772483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:30.773444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:30.773444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:30.773444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:30.773444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:30.773444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:30.773444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:30.773444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:30.773444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:30.773444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:41:30.773444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:30.780454 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 404/792] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 13:41:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:30.783804 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c2de-c07d-44f3-99e7-5afc575c38ef None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:30.926656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:31.048418 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc4736-5498-4d7e-9838-091fadca18bb None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:31.096700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:31.137143 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c2de-c07d-44f3-99e7-5afc575c38ef None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:31.149402 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac79ef-5c8d-4dee-b7c5-78157802c98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:31.151110 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac79ef-5c8d-4dee-b7c5-78157802c98d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:31.151570 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac79ef-5c8d-4dee-b7c5-78157802c98d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:31.152007 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac79ef-5c8d-4dee-b7c5-78157802c98d None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:31.157628 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac79ef-5c8d-4dee-b7c5-78157802c98d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:31.158138 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac79ef-5c8d-4dee-b7c5-78157802c98d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:31.160830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac79ef-5c8d-4dee-b7c5-78157802c98d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:31.212011 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 389/793] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 547 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:31.219078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac79ef-5c8d-4dee-b7c5-78157802c98d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:31.232914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55e931-d170-446e-9b54-8f9ae29c07e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:31.236021 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55e931-d170-446e-9b54-8f9ae29c07e3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:31.236673 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55e931-d170-446e-9b54-8f9ae29c07e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:31.237236 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55e931-d170-446e-9b54-8f9ae29c07e3 None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:31.238974 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55e931-d170-446e-9b54-8f9ae29c07e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:31.239557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55e931-d170-446e-9b54-8f9ae29c07e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:31.242523 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55e931-d170-446e-9b54-8f9ae29c07e3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:31.287227 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 405/794] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 13:41:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:31.300456 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55e931-d170-446e-9b54-8f9ae29c07e3 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:31.564235 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac79ef-5c8d-4dee-b7c5-78157802c98d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:31.633500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:31.646442 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd213f3-6ffc-4de7-9764-5d6ae2a7c9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:31.647832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd213f3-6ffc-4de7-9764-5d6ae2a7c9c2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:31.648367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd213f3-6ffc-4de7-9764-5d6ae2a7c9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:31.648851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd213f3-6ffc-4de7-9764-5d6ae2a7c9c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:31.665927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd213f3-6ffc-4de7-9764-5d6ae2a7c9c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:31.671080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd213f3-6ffc-4de7-9764-5d6ae2a7c9c2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:31.676875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55e931-d170-446e-9b54-8f9ae29c07e3 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-5cd213f3-6ffc-4de7-9764-5d6ae2a7c9c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:31.711078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:31.712792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:31.713829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:31.713829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:31.713829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:31.713829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:31.713829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:31.713829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:31.713829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:31.713829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:31.713829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:41:31.713829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:31.714812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 390/795] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:41:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 496 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:31.720480 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8887-3753-44a2-a150-79dfc97b42b7 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:31.720480 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8887-3753-44a2-a150-79dfc97b42b7 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:31.720480 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8887-3753-44a2-a150-79dfc97b42b7 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:31.722459 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 391/796] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:31.724011 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8887-3753-44a2-a150-79dfc97b42b7 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:31.741694 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b757156-2f2e-488d-80bc-0d65807d3504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:31.745233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b757156-2f2e-488d-80bc-0d65807d3504 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:31.745823 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b757156-2f2e-488d-80bc-0d65807d3504 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:31.746324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b757156-2f2e-488d-80bc-0d65807d3504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:31.776553 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b757156-2f2e-488d-80bc-0d65807d3504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:31.779528 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b757156-2f2e-488d-80bc-0d65807d3504 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-3b757156-2f2e-488d-80bc-0d65807d3504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:31.813961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:31.815795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:31.817655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:31.817655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:31.817655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:31.817655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:31.817655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 406/797] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 516 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:31.817655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601167-7bba-4db8-878e-86babf19c0dc None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:31.817655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601167-7bba-4db8-878e-86babf19c0dc None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:31.817655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601167-7bba-4db8-878e-86babf19c0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:31.831661 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:31.841373 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-9d601167-7bba-4db8-878e-86babf19c0dc None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:31.842903 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-9d601167-7bba-4db8-878e-86babf19c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:31.906839 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8887-3753-44a2-a150-79dfc97b42b7 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:31.932217 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 407/798] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:31.933527 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d601167-7bba-4db8-878e-86babf19c0dc None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:31.972812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01221191-4910-428a-a7a6-bdf60cbcea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:31.973596 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01221191-4910-428a-a7a6-bdf60cbcea07 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:31.974284 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01221191-4910-428a-a7a6-bdf60cbcea07 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:31.974575 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01221191-4910-428a-a7a6-bdf60cbcea07 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:31.975717 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01221191-4910-428a-a7a6-bdf60cbcea07 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:31.976046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01221191-4910-428a-a7a6-bdf60cbcea07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:31.977578 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01221191-4910-428a-a7a6-bdf60cbcea07 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:32.011944 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 392/799] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 13:41:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:32.015790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470e8b5-0e82-4072-8bad-ef7775b2f986 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:32.016914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470e8b5-0e82-4072-8bad-ef7775b2f986 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:32.017836 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470e8b5-0e82-4072-8bad-ef7775b2f986 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:32.019801 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 393/800] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:32.021246 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470e8b5-0e82-4072-8bad-ef7775b2f986 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:32.065358 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d601167-7bba-4db8-878e-86babf19c0dc None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:32.099029 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:32.119790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c327c8-c6f7-49de-b994-3766671eafbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:32.120514 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c327c8-c6f7-49de-b994-3766671eafbc None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:32.120795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c327c8-c6f7-49de-b994-3766671eafbc None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:32.121071 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c327c8-c6f7-49de-b994-3766671eafbc None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:32.121810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c327c8-c6f7-49de-b994-3766671eafbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:32.122178 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c327c8-c6f7-49de-b994-3766671eafbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:32.123531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c327c8-c6f7-49de-b994-3766671eafbc None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:32.126531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:32.145061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 408/801] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:32.145061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c327c8-c6f7-49de-b994-3766671eafbc None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:32.173310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470e8b5-0e82-4072-8bad-ef7775b2f986 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:32.212428 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c36da-1b4b-42ba-acd9-1dcd24b8194e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:32.213446 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c36da-1b4b-42ba-acd9-1dcd24b8194e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:32.213734 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c36da-1b4b-42ba-acd9-1dcd24b8194e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:32.214085 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c36da-1b4b-42ba-acd9-1dcd24b8194e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:32.226845 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c36da-1b4b-42ba-acd9-1dcd24b8194e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-e82c36da-1b4b-42ba-acd9-1dcd24b8194e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:32.235838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:32.237182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:32.238346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 394/802] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:32.239419 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc74cc8-e0b8-415b-a50e-3275d7596778 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:32.239419 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc74cc8-e0b8-415b-a50e-3275d7596778 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:32.239558 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc74cc8-e0b8-415b-a50e-3275d7596778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:32.262025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-2fc74cc8-e0b8-415b-a50e-3275d7596778 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:32.263367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-2fc74cc8-e0b8-415b-a50e-3275d7596778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:32.315434 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c327c8-c6f7-49de-b994-3766671eafbc None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:32.353848 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 395/803] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:32.355086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc74cc8-e0b8-415b-a50e-3275d7596778 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:32.377041 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c791e43-4c44-425f-aefb-75c738d408ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:32.378446 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c791e43-4c44-425f-aefb-75c738d408ea None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:32.379886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c791e43-4c44-425f-aefb-75c738d408ea None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:32.380613 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c791e43-4c44-425f-aefb-75c738d408ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:32.398894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c791e43-4c44-425f-aefb-75c738d408ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:32.400981 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c791e43-4c44-425f-aefb-75c738d408ea None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-4c791e43-4c44-425f-aefb-75c738d408ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:32.422949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:32.432012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:32.434316 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:32.434316 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:32.434316 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:32.434316 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:32.434316 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 409/804] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:32.434316 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c791e43-4c44-425f-aefb-75c738d408ea None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:32.436819 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:32.494057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:32.557842 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc74cc8-e0b8-415b-a50e-3275d7596778 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:32.596952 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c791e43-4c44-425f-aefb-75c738d408ea None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:32.608238 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83388524-0844-4069-affc-92e732b5a05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:32.609092 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83388524-0844-4069-affc-92e732b5a05d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:32.610090 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83388524-0844-4069-affc-92e732b5a05d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:32.610090 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83388524-0844-4069-affc-92e732b5a05d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:32.618624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83388524-0844-4069-affc-92e732b5a05d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:32.620843 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83388524-0844-4069-affc-92e732b5a05d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-83388524-0844-4069-affc-92e732b5a05d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:32.637918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:32.638982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:32.640052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:32.640052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:32.640052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:32.640052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:32.640052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:32.640052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:32.640052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:32.640052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:32.643976 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 396/805] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:32.644951 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83388524-0844-4069-affc-92e732b5a05d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:32.656937 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913685f-9175-484f-9033-d061951d61ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:32.657638 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913685f-9175-484f-9033-d061951d61ec None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:32.657921 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913685f-9175-484f-9033-d061951d61ec None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:32.658278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913685f-9175-484f-9033-d061951d61ec None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:32.658958 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913685f-9175-484f-9033-d061951d61ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:32.659267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913685f-9175-484f-9033-d061951d61ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:32.660718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913685f-9175-484f-9033-d061951d61ec None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:32.675423 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 410/806] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:32.676453 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913685f-9175-484f-9033-d061951d61ec None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:32.779798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:32.785192 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83388524-0844-4069-affc-92e732b5a05d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:32.828679 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913685f-9175-484f-9033-d061951d61ec None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:32.841191 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b4c8b-2b04-4a92-836d-657c3e8ff18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:32.842529 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b4c8b-2b04-4a92-836d-657c3e8ff18e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:32.843040 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b4c8b-2b04-4a92-836d-657c3e8ff18e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:32.843703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b4c8b-2b04-4a92-836d-657c3e8ff18e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:32.844478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b4c8b-2b04-4a92-836d-657c3e8ff18e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:32.846081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b4c8b-2b04-4a92-836d-657c3e8ff18e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:32.846435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-7f0b4c8b-2b04-4a92-836d-657c3e8ff18e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:32.861613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:32.862889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:32.864016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 397/807] 10.222.0.24 () {56 vars in 1129 bytes} [Wed May 25 13:41:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:32.865142 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b4c8b-2b04-4a92-836d-657c3e8ff18e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:32.902280 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972af3b8-1afd-4d88-8bd3-03d5c79d2e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:32.903201 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972af3b8-1afd-4d88-8bd3-03d5c79d2e2b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:32.903746 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972af3b8-1afd-4d88-8bd3-03d5c79d2e2b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:32.904063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972af3b8-1afd-4d88-8bd3-03d5c79d2e2b None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:32.905312 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972af3b8-1afd-4d88-8bd3-03d5c79d2e2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:32.905794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972af3b8-1afd-4d88-8bd3-03d5c79d2e2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:32.908564 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972af3b8-1afd-4d88-8bd3-03d5c79d2e2b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:32.932600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 411/808] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:32.934213 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972af3b8-1afd-4d88-8bd3-03d5c79d2e2b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:33.025965 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b4c8b-2b04-4a92-836d-657c3e8ff18e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:33.078121 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202d302-9327-49e0-a4e1-2364f89fde0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:33.078801 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202d302-9327-49e0-a4e1-2364f89fde0e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:33.079087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202d302-9327-49e0-a4e1-2364f89fde0e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:33.079367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202d302-9327-49e0-a4e1-2364f89fde0e None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:33.079653 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972af3b8-1afd-4d88-8bd3-03d5c79d2e2b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:33.080216 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202d302-9327-49e0-a4e1-2364f89fde0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:33.080537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202d302-9327-49e0-a4e1-2364f89fde0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:33.082114 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202d302-9327-49e0-a4e1-2364f89fde0e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:33.098536 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 398/809] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:33.099176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202d302-9327-49e0-a4e1-2364f89fde0e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:33.126818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cea47-866e-4a35-b563-b6079613285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:33.127645 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cea47-866e-4a35-b563-b6079613285f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:33.128005 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cea47-866e-4a35-b563-b6079613285f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:33.128426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cea47-866e-4a35-b563-b6079613285f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:33.131193 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:33.141235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cea47-866e-4a35-b563-b6079613285f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:33.142727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cea47-866e-4a35-b563-b6079613285f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-0a6cea47-866e-4a35-b563-b6079613285f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:33.164654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:33.166663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:33.167602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:33.167602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:33.167602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:33.167602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:33.167602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 412/810] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:33.167602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cea47-866e-4a35-b563-b6079613285f None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:33.199824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:33.236757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202d302-9327-49e0-a4e1-2364f89fde0e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:33.280911 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62001911-e167-4737-9395-de479986217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:33.281758 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62001911-e167-4737-9395-de479986217b None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:33.282169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62001911-e167-4737-9395-de479986217b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:33.282561 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62001911-e167-4737-9395-de479986217b None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:33.283750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62001911-e167-4737-9395-de479986217b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:33.284229 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62001911-e167-4737-9395-de479986217b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:33.286080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62001911-e167-4737-9395-de479986217b None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:33.294924 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 399/811] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 13:41:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:33.297290 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a73f5-56df-4283-aed7-69b249771fd4 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:33.297691 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a73f5-56df-4283-aed7-69b249771fd4 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:33.298004 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a73f5-56df-4283-aed7-69b249771fd4 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:33.299543 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 400/812] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:33.300569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a73f5-56df-4283-aed7-69b249771fd4 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:33.323467 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cea47-866e-4a35-b563-b6079613285f None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:33.374475 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5399694-9309-4bf3-b2af-88f88cd62cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:33.375833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5399694-9309-4bf3-b2af-88f88cd62cfe None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:33.376371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5399694-9309-4bf3-b2af-88f88cd62cfe None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:33.376902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5399694-9309-4bf3-b2af-88f88cd62cfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:33.390503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5399694-9309-4bf3-b2af-88f88cd62cfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:33.393175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5399694-9309-4bf3-b2af-88f88cd62cfe None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-e5399694-9309-4bf3-b2af-88f88cd62cfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:33.418696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:33.419834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:33.420764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:33.420764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:33.420764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:33.420764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:33.420764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:33.420764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:33.420764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:33.420764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:33.421185 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 413/813] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:33.422500 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5399694-9309-4bf3-b2af-88f88cd62cfe None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:33.429448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:33.449607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a73f5-56df-4283-aed7-69b249771fd4 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:33.488557 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988284d7-a6fb-4c82-ae13-585c756c1685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:33.489509 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988284d7-a6fb-4c82-ae13-585c756c1685 None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:33.489777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988284d7-a6fb-4c82-ae13-585c756c1685 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:33.490073 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988284d7-a6fb-4c82-ae13-585c756c1685 None admin] PATH_INFO: `/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/b1e5039385f44bb2b52e795524d6b8d2/roles/fecd360f4074414fb38da63038e39776` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:33.513281 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988284d7-a6fb-4c82-ae13-585c756c1685 None admin] RBAC: Authorizing `identity:create_grant(project_id=b57fe974dc4d4542a1dd930fc6912d39, user_id=b1e5039385f44bb2b52e795524d6b8d2, role_id=fecd360f4074414fb38da63038e39776)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:33.514738 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988284d7-a6fb-4c82-ae13-585c756c1685 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:33.530525 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 401/814] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:41:33 2022] PUT /identity/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/b1e5039385f44bb2b52e795524d6b8d2/roles/fecd360f4074414fb38da63038e39776 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:41:33.531499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988284d7-a6fb-4c82-ae13-585c756c1685 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:33.534186 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:33.569189 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5399694-9309-4bf3-b2af-88f88cd62cfe None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:33.644037 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913a880-9b48-49c4-b877-4649e6ba179a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:33.644703 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a880-9b48-49c4-b877-4649e6ba179a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:33.645029 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a880-9b48-49c4-b877-4649e6ba179a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:33.645303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a880-9b48-49c4-b877-4649e6ba179a None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:33.646155 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913a880-9b48-49c4-b877-4649e6ba179a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:33.646592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913a880-9b48-49c4-b877-4649e6ba179a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:33.648420 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913a880-9b48-49c4-b877-4649e6ba179a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:33.671246 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 414/815] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:33.671246 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937ffb4-2e1c-4e9e-863f-8885a5206ddf None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:33.671246 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937ffb4-2e1c-4e9e-863f-8885a5206ddf None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:33.671246 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937ffb4-2e1c-4e9e-863f-8885a5206ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:33.691281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-4937ffb4-2e1c-4e9e-863f-8885a5206ddf None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:33.692586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-4937ffb4-2e1c-4e9e-863f-8885a5206ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:33.753470 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988284d7-a6fb-4c82-ae13-585c756c1685 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:33.810267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 415/816] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:33.810267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937ffb4-2e1c-4e9e-863f-8885a5206ddf None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:33.819940 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f2d9a-659f-4a18-9ed2-17bb2c9194a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:33.823239 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f2d9a-659f-4a18-9ed2-17bb2c9194a2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:33.824748 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f2d9a-659f-4a18-9ed2-17bb2c9194a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:33.826024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f2d9a-659f-4a18-9ed2-17bb2c9194a2 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:33.828208 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f2d9a-659f-4a18-9ed2-17bb2c9194a2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:33.829420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f2d9a-659f-4a18-9ed2-17bb2c9194a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:33.834044 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f2d9a-659f-4a18-9ed2-17bb2c9194a2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:33.848408 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 402/817] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 13:41:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:33.848749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:33.855273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f2d9a-659f-4a18-9ed2-17bb2c9194a2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:33.918931 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:33.966084 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937ffb4-2e1c-4e9e-863f-8885a5206ddf None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:33.992429 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f2d9a-659f-4a18-9ed2-17bb2c9194a2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:34.018314 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03041341-435b-471b-bd22-e98a186486cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:34.019412 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03041341-435b-471b-bd22-e98a186486cb None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:34.019915 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03041341-435b-471b-bd22-e98a186486cb None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:34.020419 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03041341-435b-471b-bd22-e98a186486cb None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:34.021561 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03041341-435b-471b-bd22-e98a186486cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:34.022040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03041341-435b-471b-bd22-e98a186486cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:34.024224 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03041341-435b-471b-bd22-e98a186486cb None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:34.043001 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8055467-ad6b-4f1c-b551-4cff836034db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:34.043888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8055467-ad6b-4f1c-b551-4cff836034db None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:34.044204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8055467-ad6b-4f1c-b551-4cff836034db None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:34.044483 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8055467-ad6b-4f1c-b551-4cff836034db None admin] PATH_INFO: `/v3/users/nova` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:34.053983 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 416/818] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:34.053983 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03041341-435b-471b-bd22-e98a186486cb None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:34.066959 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8055467-ad6b-4f1c-b551-4cff836034db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:34.070062 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8055467-ad6b-4f1c-b551-4cff836034db None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-d8055467-ad6b-4f1c-b551-4cff836034db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:34.096077 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:34.097752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:34.099449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:34.099449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:34.099449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:34.099449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:34.099449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:34.099449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:34.099449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:34.099449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:34.099449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:41:34.099449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:34.099449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 403/819] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 13:41:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:34.102255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8055467-ad6b-4f1c-b551-4cff836034db None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:34.205049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:34.231231 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03041341-435b-471b-bd22-e98a186486cb None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:34.269099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:34.275085 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8424cfa-6e4d-4452-aa17-067afe73748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:34.276342 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8424cfa-6e4d-4452-aa17-067afe73748e None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:34.277384 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8424cfa-6e4d-4452-aa17-067afe73748e None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:34.277384 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8424cfa-6e4d-4452-aa17-067afe73748e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:34.278059 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8424cfa-6e4d-4452-aa17-067afe73748e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:34.279483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8424cfa-6e4d-4452-aa17-067afe73748e None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:34.295324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8055467-ad6b-4f1c-b551-4cff836034db None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:34.304015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 417/820] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 13:41:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:41:34.305313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8424cfa-6e4d-4452-aa17-067afe73748e None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:34.385719 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00177db3-9622-45c9-bd91-fb2c5f4c504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:34.388097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00177db3-9622-45c9-bd91-fb2c5f4c504f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:34.388785 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00177db3-9622-45c9-bd91-fb2c5f4c504f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:34.389248 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00177db3-9622-45c9-bd91-fb2c5f4c504f None admin] PATH_INFO: `/v3/services/network` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:34.390515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00177db3-9622-45c9-bd91-fb2c5f4c504f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:34.393807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00177db3-9622-45c9-bd91-fb2c5f4c504f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-00177db3-9622-45c9-bd91-fb2c5f4c504f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:34.422404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:34.423903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:41:34.425086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:34.428302 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 404/821] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:34 2022] GET /identity/v3/services/network => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:34.429613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00177db3-9622-45c9-bd91-fb2c5f4c504f None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:34.475741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8424cfa-6e4d-4452-aa17-067afe73748e None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:34.533181 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebadc26-b3ca-430f-a761-18aa840fe67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:34.534323 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebadc26-b3ca-430f-a761-18aa840fe67a None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:34.534668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebadc26-b3ca-430f-a761-18aa840fe67a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:34.535226 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebadc26-b3ca-430f-a761-18aa840fe67a None admin] PATH_INFO: `/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/41c94d4eb019422fbea20bba97fa77a4/roles/109ea861e27e4d75bec3ac9c5f81096e` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:34.538304 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebadc26-b3ca-430f-a761-18aa840fe67a None admin] RBAC: Authorizing `identity:create_grant(project_id=b57fe974dc4d4542a1dd930fc6912d39, user_id=41c94d4eb019422fbea20bba97fa77a4, role_id=109ea861e27e4d75bec3ac9c5f81096e)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:34.539926 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebadc26-b3ca-430f-a761-18aa840fe67a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:34.564171 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 418/822] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:41:34 2022] PUT /identity/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/41c94d4eb019422fbea20bba97fa77a4/roles/109ea861e27e4d75bec3ac9c5f81096e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:41:34.564171 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebadc26-b3ca-430f-a761-18aa840fe67a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:34.605189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00177db3-9622-45c9-bd91-fb2c5f4c504f None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:34.645520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:34.646225 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:34.657061 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7119e1-2328-4e99-a983-911e59c1e3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:34.659115 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7119e1-2328-4e99-a983-911e59c1e3a6 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:34.659456 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7119e1-2328-4e99-a983-911e59c1e3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:34.659733 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7119e1-2328-4e99-a983-911e59c1e3a6 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:34.660736 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7119e1-2328-4e99-a983-911e59c1e3a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:34.661308 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7119e1-2328-4e99-a983-911e59c1e3a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:34.663443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7119e1-2328-4e99-a983-911e59c1e3a6 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:34.687022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 405/823] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 13:41:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:34.692934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7119e1-2328-4e99-a983-911e59c1e3a6 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:34.733796 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebadc26-b3ca-430f-a761-18aa840fe67a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:34.787286 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e68ad8-ce0b-4b44-a4e2-98ff91a43f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:34.788542 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68ad8-ce0b-4b44-a4e2-98ff91a43f74 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:34.789009 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68ad8-ce0b-4b44-a4e2-98ff91a43f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:34.789907 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68ad8-ce0b-4b44-a4e2-98ff91a43f74 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:34.791558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e68ad8-ce0b-4b44-a4e2-98ff91a43f74 None admin] RBAC: Adding query filter params (name=network) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:34.792035 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e68ad8-ce0b-4b44-a4e2-98ff91a43f74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:34.794090 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e68ad8-ce0b-4b44-a4e2-98ff91a43f74 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:34.801742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 419/824] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:41:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:34.809330 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e68ad8-ce0b-4b44-a4e2-98ff91a43f74 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:34.860774 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7119e1-2328-4e99-a983-911e59c1e3a6 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:34.915608 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cf9d3-4700-4515-8e8c-fc07b611bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:34.917872 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cf9d3-4700-4515-8e8c-fc07b611bcf6 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:34.918694 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cf9d3-4700-4515-8e8c-fc07b611bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:34.919550 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cf9d3-4700-4515-8e8c-fc07b611bcf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:35.008051 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e68ad8-ce0b-4b44-a4e2-98ff91a43f74 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:35.026704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:35.031089 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:35.076652 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116cd29-4aea-4436-980b-7ee4f37c849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:35.077334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116cd29-4aea-4436-980b-7ee4f37c849b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:35.077616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116cd29-4aea-4436-980b-7ee4f37c849b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:35.078145 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116cd29-4aea-4436-980b-7ee4f37c849b None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:35.078994 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116cd29-4aea-4436-980b-7ee4f37c849b None admin] RBAC: Adding query filter params (type=network) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:35.079429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116cd29-4aea-4436-980b-7ee4f37c849b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:35.081156 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116cd29-4aea-4436-980b-7ee4f37c849b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:35.083721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cf9d3-4700-4515-8e8c-fc07b611bcf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:35.085603 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cf9d3-4700-4515-8e8c-fc07b611bcf6 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:35.100346 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 420/825] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:41:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:35.108610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116cd29-4aea-4436-980b-7ee4f37c849b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:35.314525 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116cd29-4aea-4436-980b-7ee4f37c849b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:35.315109 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 406/826] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 13:41:35.322146 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cf9d3-4700-4515-8e8c-fc07b611bcf6 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:35.356369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49119ccf-f279-4443-b5f2-41e39d7cbaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:35.357205 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49119ccf-f279-4443-b5f2-41e39d7cbaa8 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:35.357538 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49119ccf-f279-4443-b5f2-41e39d7cbaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:35.357815 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49119ccf-f279-4443-b5f2-41e39d7cbaa8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:35.358574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49119ccf-f279-4443-b5f2-41e39d7cbaa8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:35.360225 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49119ccf-f279-4443-b5f2-41e39d7cbaa8 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:35.401528 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 421/827] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 13:41:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:41:35.512424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:35.576879 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cf9d3-4700-4515-8e8c-fc07b611bcf6 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:35.733007 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d945cbc-aabd-4714-bbdd-a0fbf1312896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:35.734065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d945cbc-aabd-4714-bbdd-a0fbf1312896 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:35.734538 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d945cbc-aabd-4714-bbdd-a0fbf1312896 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:35.734978 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d945cbc-aabd-4714-bbdd-a0fbf1312896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:35.757639 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d945cbc-aabd-4714-bbdd-a0fbf1312896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:35.762245 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d945cbc-aabd-4714-bbdd-a0fbf1312896 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-1d945cbc-aabd-4714-bbdd-a0fbf1312896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:35.828232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:35.829173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:35.830069 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:35.830069 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:35.830069 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:35.830069 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:35.830069 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 407/828] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 503 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:35.830813 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49119ccf-f279-4443-b5f2-41e39d7cbaa8 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:35.895146 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:36.059559 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49119ccf-f279-4443-b5f2-41e39d7cbaa8 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:36.154244 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94846e9c-01ea-490b-99d3-c2045e2574b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:36.155329 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94846e9c-01ea-490b-99d3-c2045e2574b9 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:36.155771 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94846e9c-01ea-490b-99d3-c2045e2574b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:36.156745 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94846e9c-01ea-490b-99d3-c2045e2574b9 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:36.158362 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94846e9c-01ea-490b-99d3-c2045e2574b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:36.158841 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94846e9c-01ea-490b-99d3-c2045e2574b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:36.162475 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94846e9c-01ea-490b-99d3-c2045e2574b9 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:36.198448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 422/829] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:36.204666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d945cbc-aabd-4714-bbdd-a0fbf1312896 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:36.260769 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac183868-bce6-4fbd-ab5a-c01d7d3e2194 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:36.261109 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac183868-bce6-4fbd-ab5a-c01d7d3e2194 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:36.261339 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac183868-bce6-4fbd-ab5a-c01d7d3e2194 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:36.262809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 423/830] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:36.274053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd3530-83d7-47df-82ab-3d3b527f61fd None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:36.274518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd3530-83d7-47df-82ab-3d3b527f61fd None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:36.274707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd3530-83d7-47df-82ab-3d3b527f61fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:36.323494 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-84cd3530-83d7-47df-82ab-3d3b527f61fd None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:36.324895 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-84cd3530-83d7-47df-82ab-3d3b527f61fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:36.427271 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d945cbc-aabd-4714-bbdd-a0fbf1312896 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:36.455346 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 424/831] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:36.478185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436874a-e32c-4da0-978b-244c204d6445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:36.479814 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd3530-83d7-47df-82ab-3d3b527f61fd None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:36.481207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436874a-e32c-4da0-978b-244c204d6445 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:36.481694 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:36.482448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436874a-e32c-4da0-978b-244c204d6445 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:36.483260 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436874a-e32c-4da0-978b-244c204d6445 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:36.493561 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436874a-e32c-4da0-978b-244c204d6445 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:36.495384 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436874a-e32c-4da0-978b-244c204d6445 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-b436874a-e32c-4da0-978b-244c204d6445 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:36.514435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:36.515395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:36.516342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:36.516342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:36.516342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:36.516342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:36.516342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:36.516342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:36.516342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:36.516342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:36.522766 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 408/832] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:36.526726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:36.527833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436874a-e32c-4da0-978b-244c204d6445 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:36.658454 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd3530-83d7-47df-82ab-3d3b527f61fd None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:36.712638 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae4ec7-8def-4482-855b-92ece204eff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:36.713583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae4ec7-8def-4482-855b-92ece204eff7 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:36.713902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae4ec7-8def-4482-855b-92ece204eff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:36.714273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae4ec7-8def-4482-855b-92ece204eff7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:36.720147 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436874a-e32c-4da0-978b-244c204d6445 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:36.736791 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae4ec7-8def-4482-855b-92ece204eff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-08ae4ec7-8def-4482-855b-92ece204eff7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:36.749229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:36.750278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:36.751124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:36.751124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:36.751124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:36.751124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:36.751124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:36.751124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:36.751124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:36.751124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:36.751124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:36.751124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:36.751124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:41:36.751124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:36.756448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 425/833] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:41:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:36.758459 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae4ec7-8def-4482-855b-92ece204eff7 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:36.775354 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4ea4e-59dc-48d7-aedc-62a1043dcfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:36.776518 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4ea4e-59dc-48d7-aedc-62a1043dcfcc None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:36.777042 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4ea4e-59dc-48d7-aedc-62a1043dcfcc None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:36.778176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4ea4e-59dc-48d7-aedc-62a1043dcfcc None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:36.779789 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4ea4e-59dc-48d7-aedc-62a1043dcfcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:36.780375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4ea4e-59dc-48d7-aedc-62a1043dcfcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:36.782435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4ea4e-59dc-48d7-aedc-62a1043dcfcc None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:36.804199 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 409/834] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:36.814651 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4ea4e-59dc-48d7-aedc-62a1043dcfcc None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:36.904636 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:36.920229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:36.964691 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae4ec7-8def-4482-855b-92ece204eff7 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:36.994889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4ea4e-59dc-48d7-aedc-62a1043dcfcc None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:37.034201 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b9fb7-26d7-4092-b3e4-5c7dfca4a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:37.035337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b9fb7-26d7-4092-b3e4-5c7dfca4a617 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:37.035928 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b9fb7-26d7-4092-b3e4-5c7dfca4a617 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:37.036448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b9fb7-26d7-4092-b3e4-5c7dfca4a617 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:37.037572 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b9fb7-26d7-4092-b3e4-5c7dfca4a617 None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:37.038203 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b9fb7-26d7-4092-b3e4-5c7dfca4a617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:37.040532 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b9fb7-26d7-4092-b3e4-5c7dfca4a617 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:37.056313 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8f252-530a-4e16-8c64-e23b3f1dfd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:37.056313 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8f252-530a-4e16-8c64-e23b3f1dfd66 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:37.056940 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8f252-530a-4e16-8c64-e23b3f1dfd66 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:37.057210 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8f252-530a-4e16-8c64-e23b3f1dfd66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:37.063443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8f252-530a-4e16-8c64-e23b3f1dfd66 None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=971eae8a8ad44ce893c311b74acbd76b) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:37.063443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8f252-530a-4e16-8c64-e23b3f1dfd66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:37.063443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8f252-530a-4e16-8c64-e23b3f1dfd66 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:37.064183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 426/835] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:41:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:37.066725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b9fb7-26d7-4092-b3e4-5c7dfca4a617 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:37.072265 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 410/836] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:36 2022] GET /identity/v3/role_assignments?user.id=971eae8a8ad44ce893c311b74acbd76b&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:37.234241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b9fb7-26d7-4092-b3e4-5c7dfca4a617 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:37.292579 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6edfa2-d793-4dea-bb3d-070144d064ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:37.293674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6edfa2-d793-4dea-bb3d-070144d064ba None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:37.294046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6edfa2-d793-4dea-bb3d-070144d064ba None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:37.294413 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6edfa2-d793-4dea-bb3d-070144d064ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:37.310677 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6edfa2-d793-4dea-bb3d-070144d064ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:37.312479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6edfa2-d793-4dea-bb3d-070144d064ba None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:37.316578 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-dd6edfa2-d793-4dea-bb3d-070144d064ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:37.335432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:37.336491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:37.339302 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:37.339302 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:37.339302 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:37.339302 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:37.339302 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 427/837] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:37.345847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8f252-530a-4e16-8c64-e23b3f1dfd66 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:37.391297 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116e488-54e3-4c19-93f5-2dabd117a8ff None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:37.391623 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116e488-54e3-4c19-93f5-2dabd117a8ff None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:37.391865 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116e488-54e3-4c19-93f5-2dabd117a8ff None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:37.393599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 428/838] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:41:37.399870 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ef5ea-fcdd-428c-b5fe-801371af4e64 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:37.400245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ef5ea-fcdd-428c-b5fe-801371af4e64 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:37.400517 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ef5ea-fcdd-428c-b5fe-801371af4e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:37.420745 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-4a3ef5ea-fcdd-428c-b5fe-801371af4e64 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:37.421985 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-4a3ef5ea-fcdd-428c-b5fe-801371af4e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:37.512159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8f252-530a-4e16-8c64-e23b3f1dfd66 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:37.522036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 429/839] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:37.531665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:37.551371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ef5ea-fcdd-428c-b5fe-801371af4e64 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:37.578910 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66968772-4296-47a4-8a66-f5710c6260b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:37.579750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66968772-4296-47a4-8a66-f5710c6260b6 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:37.580058 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66968772-4296-47a4-8a66-f5710c6260b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:37.580389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66968772-4296-47a4-8a66-f5710c6260b6 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:37.581284 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66968772-4296-47a4-8a66-f5710c6260b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:37.581619 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66968772-4296-47a4-8a66-f5710c6260b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:37.583148 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66968772-4296-47a4-8a66-f5710c6260b6 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:37.601931 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 411/840] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:37.609606 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66968772-4296-47a4-8a66-f5710c6260b6 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:37.710133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ef5ea-fcdd-428c-b5fe-801371af4e64 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:37.759451 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:37.776058 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04469ee0-fa4b-4fc6-8384-d3b36937d342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:37.777680 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04469ee0-fa4b-4fc6-8384-d3b36937d342 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:37.778532 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04469ee0-fa4b-4fc6-8384-d3b36937d342 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:37.779317 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04469ee0-fa4b-4fc6-8384-d3b36937d342 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:37.780418 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04469ee0-fa4b-4fc6-8384-d3b36937d342 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:37.782639 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04469ee0-fa4b-4fc6-8384-d3b36937d342 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-04469ee0-fa4b-4fc6-8384-d3b36937d342 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:37.802855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:37.804140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:41:37.805040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:37.806056 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66968772-4296-47a4-8a66-f5710c6260b6 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:37.815383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 430/841] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:41:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:37.816710 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04469ee0-fa4b-4fc6-8384-d3b36937d342 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:37.874695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd5918-7eaa-4c96-a052-75fc54461e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:37.875622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd5918-7eaa-4c96-a052-75fc54461e13 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:37.875924 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd5918-7eaa-4c96-a052-75fc54461e13 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:37.876278 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd5918-7eaa-4c96-a052-75fc54461e13 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:37.887846 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd5918-7eaa-4c96-a052-75fc54461e13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:37.889520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd5918-7eaa-4c96-a052-75fc54461e13 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-d1bd5918-7eaa-4c96-a052-75fc54461e13 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:37.908523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:37.910053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:37.911502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:37.911502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:37.911502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:37.911502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:37.911502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:37.911502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:37.911502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:37.911502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:37.911502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:41:37.911502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:37.911502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 412/842] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 13:41:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:37.917779 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3e0d0-9e76-449d-bb54-f58516fa0a88 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:37.918099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3e0d0-9e76-449d-bb54-f58516fa0a88 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:37.918408 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3e0d0-9e76-449d-bb54-f58516fa0a88 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:37.920581 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 413/843] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:37.921377 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3e0d0-9e76-449d-bb54-f58516fa0a88 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:37.959802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:37.982334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04469ee0-fa4b-4fc6-8384-d3b36937d342 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:38.028022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09918eed-8c92-47a7-8c20-b872e22a0ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:38.028679 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09918eed-8c92-47a7-8c20-b872e22a0ec9 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:38.028839 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09918eed-8c92-47a7-8c20-b872e22a0ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:38.029181 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09918eed-8c92-47a7-8c20-b872e22a0ec9 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:38.030163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09918eed-8c92-47a7-8c20-b872e22a0ec9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:38.030482 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09918eed-8c92-47a7-8c20-b872e22a0ec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:38.032065 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09918eed-8c92-47a7-8c20-b872e22a0ec9 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:38.045922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 431/844] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:41:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:38.047828 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d881fdb-29f5-4250-a45d-73f72080211c None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:38.048159 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d881fdb-29f5-4250-a45d-73f72080211c None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:38.048490 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d881fdb-29f5-4250-a45d-73f72080211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:38.062990 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3e0d0-9e76-449d-bb54-f58516fa0a88 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:38.067989 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-3d881fdb-29f5-4250-a45d-73f72080211c None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:38.069472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-3d881fdb-29f5-4250-a45d-73f72080211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:38.106504 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b510a-b179-4035-b86d-10e8e25f8957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:38.107174 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b510a-b179-4035-b86d-10e8e25f8957 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:38.107459 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b510a-b179-4035-b86d-10e8e25f8957 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:38.107769 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b510a-b179-4035-b86d-10e8e25f8957 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:38.108622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b510a-b179-4035-b86d-10e8e25f8957 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:38.109055 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b510a-b179-4035-b86d-10e8e25f8957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:38.110651 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b510a-b179-4035-b86d-10e8e25f8957 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:38.133089 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:38.134425 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 414/845] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 13:41:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:38.135647 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b510a-b179-4035-b86d-10e8e25f8957 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:38.157774 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 432/846] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:38.159072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d881fdb-29f5-4250-a45d-73f72080211c None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:38.284200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:38.299584 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b510a-b179-4035-b86d-10e8e25f8957 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:38.315148 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d881fdb-29f5-4250-a45d-73f72080211c None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:38.341492 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7aa44-b9ff-4834-abcb-0accf3e0562d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:38.342184 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7aa44-b9ff-4834-abcb-0accf3e0562d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:38.342447 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7aa44-b9ff-4834-abcb-0accf3e0562d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:38.342725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7aa44-b9ff-4834-abcb-0accf3e0562d None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:38.343733 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7aa44-b9ff-4834-abcb-0accf3e0562d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:38.343733 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7aa44-b9ff-4834-abcb-0accf3e0562d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:38.345159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7aa44-b9ff-4834-abcb-0accf3e0562d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:38.351069 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 415/847] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:41:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:38.353452 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7aa44-b9ff-4834-abcb-0accf3e0562d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:38.380901 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1fe41-3e8f-48af-be29-7c91466d8c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:38.382163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1fe41-3e8f-48af-be29-7c91466d8c90 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:38.382714 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1fe41-3e8f-48af-be29-7c91466d8c90 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:38.383362 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1fe41-3e8f-48af-be29-7c91466d8c90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:38.461302 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:38.485182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1fe41-3e8f-48af-be29-7c91466d8c90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:38.487360 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1fe41-3e8f-48af-be29-7c91466d8c90 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:38.523154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7aa44-b9ff-4834-abcb-0accf3e0562d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:38.579898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad891-541f-46ed-8c43-c3418da3d731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:38.580916 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad891-541f-46ed-8c43-c3418da3d731 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:38.581149 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad891-541f-46ed-8c43-c3418da3d731 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:38.581430 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad891-541f-46ed-8c43-c3418da3d731 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:38.597514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ad891-541f-46ed-8c43-c3418da3d731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-693ad891-541f-46ed-8c43-c3418da3d731 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:38.605775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:38.606762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:38.607615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 416/848] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:38.613058 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad891-541f-46ed-8c43-c3418da3d731 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:38.632159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:38.638202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 433/849] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:41:38.644266 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1fe41-3e8f-48af-be29-7c91466d8c90 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:38.764846 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:38.771993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad891-541f-46ed-8c43-c3418da3d731 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:38.795491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1fe41-3e8f-48af-be29-7c91466d8c90 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:38.829382 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901730b4-d234-42d0-bc33-2ac612f05e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:38.830793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901730b4-d234-42d0-bc33-2ac612f05e4e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:38.831337 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901730b4-d234-42d0-bc33-2ac612f05e4e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:38.831937 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901730b4-d234-42d0-bc33-2ac612f05e4e None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:38.833511 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901730b4-d234-42d0-bc33-2ac612f05e4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:38.834176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901730b4-d234-42d0-bc33-2ac612f05e4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:38.837588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901730b4-d234-42d0-bc33-2ac612f05e4e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:38.850390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4c1c2-78c0-4950-a1c4-1ede86f02b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:38.851204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c1c2-78c0-4950-a1c4-1ede86f02b86 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:38.851490 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c1c2-78c0-4950-a1c4-1ede86f02b86 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:38.851768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c1c2-78c0-4950-a1c4-1ede86f02b86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:38.858074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 417/850] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:41:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:38.859527 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901730b4-d234-42d0-bc33-2ac612f05e4e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:38.865021 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4c1c2-78c0-4950-a1c4-1ede86f02b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:38.866560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4c1c2-78c0-4950-a1c4-1ede86f02b86 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-5ff4c1c2-78c0-4950-a1c4-1ede86f02b86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:38.888599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:38.889598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:38.890744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:38.890744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:38.890744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:38.890744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:38.890744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 434/851] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:38.896458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4c1c2-78c0-4950-a1c4-1ede86f02b86 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:38.961309 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:38.994395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901730b4-d234-42d0-bc33-2ac612f05e4e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:39.033207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a0205-d14e-4775-b814-0e1bb502fcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:39.034061 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a0205-d14e-4775-b814-0e1bb502fcec None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:39.034357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a0205-d14e-4775-b814-0e1bb502fcec None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:39.034641 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a0205-d14e-4775-b814-0e1bb502fcec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:39.041382 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4c1c2-78c0-4950-a1c4-1ede86f02b86 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:39.048622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a0205-d14e-4775-b814-0e1bb502fcec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:39.050238 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a0205-d14e-4775-b814-0e1bb502fcec None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-168a0205-d14e-4775-b814-0e1bb502fcec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:39.069534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:39.070697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:39.071646 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:39.071646 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:39.071646 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:39.071646 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:39.075811 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 418/852] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:39.076978 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a0205-d14e-4775-b814-0e1bb502fcec None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:39.094057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599d558-1f82-43f8-adc0-0053798b5477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:39.095738 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599d558-1f82-43f8-adc0-0053798b5477 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:39.096440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599d558-1f82-43f8-adc0-0053798b5477 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:39.097056 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599d558-1f82-43f8-adc0-0053798b5477 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:39.098207 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599d558-1f82-43f8-adc0-0053798b5477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:39.098794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599d558-1f82-43f8-adc0-0053798b5477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:39.100884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599d558-1f82-43f8-adc0-0053798b5477 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:39.105294 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:39.118621 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 435/853] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:39.124949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599d558-1f82-43f8-adc0-0053798b5477 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:39.242940 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a0205-d14e-4775-b814-0e1bb502fcec None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:39.280690 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:39.295061 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6bb9e-3275-4d64-a693-6fe3ccc03c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:39.296075 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6bb9e-3275-4d64-a693-6fe3ccc03c2c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:39.296619 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6bb9e-3275-4d64-a693-6fe3ccc03c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:39.296999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6bb9e-3275-4d64-a693-6fe3ccc03c2c None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:39.297858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6bb9e-3275-4d64-a693-6fe3ccc03c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:39.298296 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6bb9e-3275-4d64-a693-6fe3ccc03c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:39.300620 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6bb9e-3275-4d64-a693-6fe3ccc03c2c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:39.307195 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599d558-1f82-43f8-adc0-0053798b5477 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:39.320170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 419/854] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:39.330074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6bb9e-3275-4d64-a693-6fe3ccc03c2c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:39.380897 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62725a3-6b30-48bd-954d-6985e45760a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:39.382290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62725a3-6b30-48bd-954d-6985e45760a8 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:39.382768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62725a3-6b30-48bd-954d-6985e45760a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:39.383132 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62725a3-6b30-48bd-954d-6985e45760a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:39.397235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62725a3-6b30-48bd-954d-6985e45760a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:39.399927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62725a3-6b30-48bd-954d-6985e45760a8 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-d62725a3-6b30-48bd-954d-6985e45760a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:39.420741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:39.422470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:39.429014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:39.429014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:39.429014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:39.429014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:39.429014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:39.429014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:39.429014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:39.429014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:39.429014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 436/855] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:39.434784 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62725a3-6b30-48bd-954d-6985e45760a8 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:39.496352 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6bb9e-3275-4d64-a693-6fe3ccc03c2c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:39.518876 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:39.549066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af3747-4b4b-49fc-85da-15dc8f56f6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:39.550261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af3747-4b4b-49fc-85da-15dc8f56f6ea None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:39.550747 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af3747-4b4b-49fc-85da-15dc8f56f6ea None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:39.551223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af3747-4b4b-49fc-85da-15dc8f56f6ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:39.560217 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af3747-4b4b-49fc-85da-15dc8f56f6ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:39.562084 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af3747-4b4b-49fc-85da-15dc8f56f6ea None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-b6af3747-4b4b-49fc-85da-15dc8f56f6ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:39.579214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:39.580249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:39.581196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:39.581196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:39.581196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:39.581196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:39.581196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:39.581196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:39.581196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:39.581196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:39.581196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:41:39.581196 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:39.581731 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62725a3-6b30-48bd-954d-6985e45760a8 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:39.583955 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 420/856] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:41:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:39.590829 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af3747-4b4b-49fc-85da-15dc8f56f6ea None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:39.649714 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fa371-b361-414d-8d1f-23f3f166b7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:39.651380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fa371-b361-414d-8d1f-23f3f166b7f6 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:39.651992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fa371-b361-414d-8d1f-23f3f166b7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:39.652608 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fa371-b361-414d-8d1f-23f3f166b7f6 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:39.653812 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fa371-b361-414d-8d1f-23f3f166b7f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:39.654416 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fa371-b361-414d-8d1f-23f3f166b7f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:39.656507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fa371-b361-414d-8d1f-23f3f166b7f6 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:39.661225 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:39.676395 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 437/857] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:39.677715 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fa371-b361-414d-8d1f-23f3f166b7f6 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:39.738710 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af3747-4b4b-49fc-85da-15dc8f56f6ea None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:39.791756 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2645e-2c48-45fe-9f9c-98e2c617e48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:39.792653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2645e-2c48-45fe-9f9c-98e2c617e48c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:39.792943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2645e-2c48-45fe-9f9c-98e2c617e48c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:39.793230 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2645e-2c48-45fe-9f9c-98e2c617e48c None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:39.794093 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2645e-2c48-45fe-9f9c-98e2c617e48c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:39.794408 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2645e-2c48-45fe-9f9c-98e2c617e48c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:39.795886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2645e-2c48-45fe-9f9c-98e2c617e48c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:39.827825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 421/858] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 13:41:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:39.827825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602f6a-d7aa-4356-bf14-ce296ff2b213 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:39.827825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602f6a-d7aa-4356-bf14-ce296ff2b213 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:39.827825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602f6a-d7aa-4356-bf14-ce296ff2b213 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:39.827825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 422/859] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:39.829084 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ab8a-67b0-4a12-8886-257ef7968cbd None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:39.829084 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ab8a-67b0-4a12-8886-257ef7968cbd None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:39.829371 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ab8a-67b0-4a12-8886-257ef7968cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:39.843663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fa371-b361-414d-8d1f-23f3f166b7f6 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:39.849096 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-7863ab8a-67b0-4a12-8886-257ef7968cbd None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:39.851203 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-7863ab8a-67b0-4a12-8886-257ef7968cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:39.863534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:39.890719 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba051e76-a055-463d-8c2a-09b8227b9e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:39.891817 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba051e76-a055-463d-8c2a-09b8227b9e0b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:39.892256 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba051e76-a055-463d-8c2a-09b8227b9e0b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:39.892708 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba051e76-a055-463d-8c2a-09b8227b9e0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:39.893849 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba051e76-a055-463d-8c2a-09b8227b9e0b None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=b1e5039385f44bb2b52e795524d6b8d2) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:39.894387 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba051e76-a055-463d-8c2a-09b8227b9e0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:39.896709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba051e76-a055-463d-8c2a-09b8227b9e0b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:39.906913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 438/860] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:39 2022] GET /identity/v3/role_assignments?user.id=b1e5039385f44bb2b52e795524d6b8d2&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:39.907734 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba051e76-a055-463d-8c2a-09b8227b9e0b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:40.003287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 423/861] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:41:40.031502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863ab8a-67b0-4a12-8886-257ef7968cbd None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:40.076804 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba051e76-a055-463d-8c2a-09b8227b9e0b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:40.081219 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:40.124018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699b0c7-4276-45b5-a222-02a7b305fb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:40.124827 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699b0c7-4276-45b5-a222-02a7b305fb00 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:40.125120 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699b0c7-4276-45b5-a222-02a7b305fb00 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:40.125397 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699b0c7-4276-45b5-a222-02a7b305fb00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:40.177538 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863ab8a-67b0-4a12-8886-257ef7968cbd None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:40.199985 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:40.232888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d79ad-d567-41af-ba4c-c870612c10ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:40.234348 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d79ad-d567-41af-ba4c-c870612c10ef None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:40.234635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d79ad-d567-41af-ba4c-c870612c10ef None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:40.234915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d79ad-d567-41af-ba4c-c870612c10ef None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:40.235596 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d79ad-d567-41af-ba4c-c870612c10ef None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:40.237096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699b0c7-4276-45b5-a222-02a7b305fb00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:40.238690 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d79ad-d567-41af-ba4c-c870612c10ef None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:40.241371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699b0c7-4276-45b5-a222-02a7b305fb00 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-482d79ad-d567-41af-ba4c-c870612c10ef None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:40.256807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:40.258982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:40.262098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 424/862] 10.222.0.24 () {56 vars in 1132 bytes} [Wed May 25 13:41:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:40.268444 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d79ad-d567-41af-ba4c-c870612c10ef None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:40.399617 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:40.401530 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 439/863] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:41:40.408585 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699b0c7-4276-45b5-a222-02a7b305fb00 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:40.411636 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d79ad-d567-41af-ba4c-c870612c10ef None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:40.468559 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08a26d-315d-4078-bda6-e49f73fc9225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:40.469810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08a26d-315d-4078-bda6-e49f73fc9225 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:40.470461 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08a26d-315d-4078-bda6-e49f73fc9225 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:40.471085 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08a26d-315d-4078-bda6-e49f73fc9225 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:40.472586 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08a26d-315d-4078-bda6-e49f73fc9225 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:40.473271 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08a26d-315d-4078-bda6-e49f73fc9225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:40.476008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08a26d-315d-4078-bda6-e49f73fc9225 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:40.492470 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 425/864] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 13:41:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:40.495685 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08a26d-315d-4078-bda6-e49f73fc9225 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:40.520543 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:40.544161 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699b0c7-4276-45b5-a222-02a7b305fb00 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:40.590061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e6f6c-a99d-4e32-8a80-c11abf0e6d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:40.590927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e6f6c-a99d-4e32-8a80-c11abf0e6d7a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:40.591218 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e6f6c-a99d-4e32-8a80-c11abf0e6d7a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:40.591493 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e6f6c-a99d-4e32-8a80-c11abf0e6d7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:40.604699 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e6f6c-a99d-4e32-8a80-c11abf0e6d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:40.606533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e6f6c-a99d-4e32-8a80-c11abf0e6d7a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:40.623465 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08a26d-315d-4078-bda6-e49f73fc9225 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-808e6f6c-a99d-4e32-8a80-c11abf0e6d7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:40.626837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:40.627948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:40.628913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:40.628913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:40.628913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:40.628913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:40.628913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 440/865] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:40.637375 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e6f6c-a99d-4e32-8a80-c11abf0e6d7a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:40.674277 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee24e4-5b11-463b-9430-f8eabae9086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:40.674956 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee24e4-5b11-463b-9430-f8eabae9086a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:40.675238 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee24e4-5b11-463b-9430-f8eabae9086a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:40.675512 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee24e4-5b11-463b-9430-f8eabae9086a None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:40.676268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee24e4-5b11-463b-9430-f8eabae9086a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:40.676574 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee24e4-5b11-463b-9430-f8eabae9086a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:40.678064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee24e4-5b11-463b-9430-f8eabae9086a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:40.692781 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 426/866] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 13:41:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:40.822792 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e6f6c-a99d-4e32-8a80-c11abf0e6d7a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:40.863506 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:40.867086 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79322e-c199-4be2-a03b-be60aa640aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:40.868608 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79322e-c199-4be2-a03b-be60aa640aa1 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:40.868985 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79322e-c199-4be2-a03b-be60aa640aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:40.869505 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79322e-c199-4be2-a03b-be60aa640aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:40.870315 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79322e-c199-4be2-a03b-be60aa640aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:40.870808 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79322e-c199-4be2-a03b-be60aa640aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:40.872271 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79322e-c199-4be2-a03b-be60aa640aa1 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:40.889250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 441/867] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:40.894609 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee24e4-5b11-463b-9430-f8eabae9086a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:40.935013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:40.982517 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f54eba-c23b-4208-9a10-7e3d720a7dc0 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:40.982814 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f54eba-c23b-4208-9a10-7e3d720a7dc0 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:40.983093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f54eba-c23b-4208-9a10-7e3d720a7dc0 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:40.988253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 442/868] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:41:40.990962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955bff4-fe10-42c3-a4ae-a8561edf348a None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:40.991276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955bff4-fe10-42c3-a4ae-a8561edf348a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:40.991565 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955bff4-fe10-42c3-a4ae-a8561edf348a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:41.024317 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-a955bff4-fe10-42c3-a4ae-a8561edf348a None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:41.026090 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-a955bff4-fe10-42c3-a4ae-a8561edf348a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:41.060139 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee24e4-5b11-463b-9430-f8eabae9086a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:41.112949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c90946-1d98-4f9d-b21e-cd022b19b0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:41.113715 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c90946-1d98-4f9d-b21e-cd022b19b0a9 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:41.114001 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c90946-1d98-4f9d-b21e-cd022b19b0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:41.114282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c90946-1d98-4f9d-b21e-cd022b19b0a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:41.124957 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c90946-1d98-4f9d-b21e-cd022b19b0a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:41.126590 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c90946-1d98-4f9d-b21e-cd022b19b0a9 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:41.144265 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 443/869] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-e9c90946-1d98-4f9d-b21e-cd022b19b0a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:41.144813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:41.145745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:41.146888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:41.146888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:41.146888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:41.146888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:41.146888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:41.146888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:41.146888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:41.146888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:41.146888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 427/870] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:41.154013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c90946-1d98-4f9d-b21e-cd022b19b0a9 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:41.169511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955bff4-fe10-42c3-a4ae-a8561edf348a None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:41.257953 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:41.278632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c90946-1d98-4f9d-b21e-cd022b19b0a9 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:41.332719 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98deb0-665b-4d8a-a15f-0dd1b5a90885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:41.334110 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98deb0-665b-4d8a-a15f-0dd1b5a90885 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:41.334633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98deb0-665b-4d8a-a15f-0dd1b5a90885 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:41.335767 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98deb0-665b-4d8a-a15f-0dd1b5a90885 None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:41.338352 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98deb0-665b-4d8a-a15f-0dd1b5a90885 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:41.338925 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98deb0-665b-4d8a-a15f-0dd1b5a90885 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:41.341893 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98deb0-665b-4d8a-a15f-0dd1b5a90885 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:41.350175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955bff4-fe10-42c3-a4ae-a8561edf348a None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:41.373968 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 428/871] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:41.375932 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98deb0-665b-4d8a-a15f-0dd1b5a90885 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:41.392331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:41.422175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13446da8-bbdd-4b6e-adcd-d23d22428183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:41.423171 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446da8-bbdd-4b6e-adcd-d23d22428183 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:41.423609 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446da8-bbdd-4b6e-adcd-d23d22428183 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:41.423919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446da8-bbdd-4b6e-adcd-d23d22428183 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:41.425952 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13446da8-bbdd-4b6e-adcd-d23d22428183 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:41.426256 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13446da8-bbdd-4b6e-adcd-d23d22428183 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:41.452320 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 444/872] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:41:41 2022] POST /identity/v3/services => generated 251 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:41:41.533540 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98deb0-665b-4d8a-a15f-0dd1b5a90885 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:41.582707 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e2fb-6a5f-44f3-959a-d850af6c463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:41.583784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e2fb-6a5f-44f3-959a-d850af6c463e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:41.584330 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e2fb-6a5f-44f3-959a-d850af6c463e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:41.584812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e2fb-6a5f-44f3-959a-d850af6c463e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:41.585909 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58e2fb-6a5f-44f3-959a-d850af6c463e None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=41c94d4eb019422fbea20bba97fa77a4) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:41.587241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58e2fb-6a5f-44f3-959a-d850af6c463e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:41.589178 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58e2fb-6a5f-44f3-959a-d850af6c463e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:41.597039 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 429/873] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:41 2022] GET /identity/v3/role_assignments?user.id=41c94d4eb019422fbea20bba97fa77a4&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:42.650850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46183e-4f5b-41d0-a77d-6349dad74776 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:42.651389 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46183e-4f5b-41d0-a77d-6349dad74776 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:42.651389 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46183e-4f5b-41d0-a77d-6349dad74776 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:42.653250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 445/874] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:42.658800 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acb5a5-c0cf-4ea0-a816-a3568b0b2833 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:42.659286 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acb5a5-c0cf-4ea0-a816-a3568b0b2833 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:42.659376 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acb5a5-c0cf-4ea0-a816-a3568b0b2833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:42.671234 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:42.677193 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-c3acb5a5-c0cf-4ea0-a816-a3568b0b2833 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:42.678405 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-c3acb5a5-c0cf-4ea0-a816-a3568b0b2833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:42.765056 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 430/875] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:42.789435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46183e-4f5b-41d0-a77d-6349dad74776 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:42.928347 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46183e-4f5b-41d0-a77d-6349dad74776 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:42.974854 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c0265-be32-4479-8546-e37d5d735bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:42.975817 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c0265-be32-4479-8546-e37d5d735bb0 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:42.976159 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c0265-be32-4479-8546-e37d5d735bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:42.976436 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c0265-be32-4479-8546-e37d5d735bb0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:42.990523 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c0265-be32-4479-8546-e37d5d735bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-d44c0265-be32-4479-8546-e37d5d735bb0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:43.000333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:43.001383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:43.002235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:43.002235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:43.002235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:43.002235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:43.002235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:43.002235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:43.002235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:43.002235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:43.002235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:43.002235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:43.002235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:41:43.002235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:43.002874 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 446/876] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 13:41:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:43.011227 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acb5a5-c0cf-4ea0-a816-a3568b0b2833 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:43.145726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acb5a5-c0cf-4ea0-a816-a3568b0b2833 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:43.189682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe23f9-4217-4994-9fd1-acf6826e96a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:43.190370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe23f9-4217-4994-9fd1-acf6826e96a1 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:43.190721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe23f9-4217-4994-9fd1-acf6826e96a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:43.191016 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe23f9-4217-4994-9fd1-acf6826e96a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:43.191887 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe23f9-4217-4994-9fd1-acf6826e96a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:43.192234 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe23f9-4217-4994-9fd1-acf6826e96a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:43.194028 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe23f9-4217-4994-9fd1-acf6826e96a1 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:43.197410 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:43.205285 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 431/877] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 13:41:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:43.211505 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c0265-be32-4479-8546-e37d5d735bb0 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:43.265538 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:43.329397 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c0265-be32-4479-8546-e37d5d735bb0 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:43.370661 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59d51-2c6d-4657-9ad3-e94d353375da None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:43.371088 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59d51-2c6d-4657-9ad3-e94d353375da None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:43.371351 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59d51-2c6d-4657-9ad3-e94d353375da None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:43.372271 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7811a-7c8e-4c47-8976-c385298ffc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:43.373159 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7811a-7c8e-4c47-8976-c385298ffc3d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:43.373325 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 432/878] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:43.373457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7811a-7c8e-4c47-8976-c385298ffc3d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:43.373756 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7811a-7c8e-4c47-8976-c385298ffc3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:43.378995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6e50a-d14f-41fc-b4c5-70f3a63d5ee1 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:43.379371 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6e50a-d14f-41fc-b4c5-70f3a63d5ee1 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:43.379631 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6e50a-d14f-41fc-b4c5-70f3a63d5ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:43.389642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7811a-7c8e-4c47-8976-c385298ffc3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:43.391287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7811a-7c8e-4c47-8976-c385298ffc3d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:43.399151 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-c8e6e50a-d14f-41fc-b4c5-70f3a63d5ee1 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:43.400458 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-c8e6e50a-d14f-41fc-b4c5-70f3a63d5ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-68d7811a-7c8e-4c47-8976-c385298ffc3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:43.411567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:43.413421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:43.415320 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:43.415320 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:43.415320 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:43.415320 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:43.415320 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 447/879] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:43.420696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7811a-7c8e-4c47-8976-c385298ffc3d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:43.499162 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 433/880] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:43 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:43.525173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6e50a-d14f-41fc-b4c5-70f3a63d5ee1 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:43.549556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:43.562535 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7811a-7c8e-4c47-8976-c385298ffc3d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:43.611913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47f4da-fd72-47ed-acac-420547f60fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:43.613000 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47f4da-fd72-47ed-acac-420547f60fcf None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:43.613524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47f4da-fd72-47ed-acac-420547f60fcf None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:43.614042 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47f4da-fd72-47ed-acac-420547f60fcf None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:43.615154 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47f4da-fd72-47ed-acac-420547f60fcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:43.615749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47f4da-fd72-47ed-acac-420547f60fcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:43.618058 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47f4da-fd72-47ed-acac-420547f60fcf None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:43.639622 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 448/881] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:43.641107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47f4da-fd72-47ed-acac-420547f60fcf None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:43.681047 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6e50a-d14f-41fc-b4c5-70f3a63d5ee1 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:43.730501 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:43.739451 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763710b-6ec1-4424-ada6-76cb09af6e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:43.740463 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763710b-6ec1-4424-ada6-76cb09af6e1e None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:43.740895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763710b-6ec1-4424-ada6-76cb09af6e1e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:43.741316 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763710b-6ec1-4424-ada6-76cb09af6e1e None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:43.742328 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763710b-6ec1-4424-ada6-76cb09af6e1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:43.744818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763710b-6ec1-4424-ada6-76cb09af6e1e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:43.767885 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 434/882] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:41:43 2022] POST /identity/v3/services => generated 269 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:41:43.785492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47f4da-fd72-47ed-acac-420547f60fcf None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:43.843787 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2b5f1-7103-43fd-9c68-750dba50ea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:43.845355 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2b5f1-7103-43fd-9c68-750dba50ea15 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:43.845992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2b5f1-7103-43fd-9c68-750dba50ea15 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:43.846467 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2b5f1-7103-43fd-9c68-750dba50ea15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:43.858686 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2b5f1-7103-43fd-9c68-750dba50ea15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:43.861029 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2b5f1-7103-43fd-9c68-750dba50ea15 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-6de2b5f1-7103-43fd-9c68-750dba50ea15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:43.881259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:43.882324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:43.883349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:43.883349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:43.883349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:43.883349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:43.883349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:43.883349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:43.883349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:43.883349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:43.883349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:41:43.883349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:43.887068 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 449/883] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 13:41:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:43.897590 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763710b-6ec1-4424-ada6-76cb09af6e1e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:44.051374 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763710b-6ec1-4424-ada6-76cb09af6e1e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:44.113498 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32660eeb-646d-4a74-a89e-b2e7286a1aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:44.114943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32660eeb-646d-4a74-a89e-b2e7286a1aab None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:44.115647 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32660eeb-646d-4a74-a89e-b2e7286a1aab None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:44.116400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32660eeb-646d-4a74-a89e-b2e7286a1aab None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:44.119031 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32660eeb-646d-4a74-a89e-b2e7286a1aab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:44.119844 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32660eeb-646d-4a74-a89e-b2e7286a1aab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:44.122975 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32660eeb-646d-4a74-a89e-b2e7286a1aab None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:44.157104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 435/884] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 13:41:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:44.162069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2b5f1-7103-43fd-9c68-750dba50ea15 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:44.180975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:44.220605 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b0d84-2670-4f59-b26a-a33bb78db76a None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:44.220906 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b0d84-2670-4f59-b26a-a33bb78db76a None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:44.221207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b0d84-2670-4f59-b26a-a33bb78db76a None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:44.223188 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 436/885] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:44.229349 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801ce22-f405-4b95-83ed-9cb6e3737885 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:44.229777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801ce22-f405-4b95-83ed-9cb6e3737885 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:44.230069 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801ce22-f405-4b95-83ed-9cb6e3737885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:44.249865 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-f801ce22-f405-4b95-83ed-9cb6e3737885 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:44.251217 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-f801ce22-f405-4b95-83ed-9cb6e3737885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:44.316909 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2b5f1-7103-43fd-9c68-750dba50ea15 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:44.324088 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:44.360972 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 437/886] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:41:44.362790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2483f77-eeb2-4790-9adf-791a6c18164d None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:44.363205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2483f77-eeb2-4790-9adf-791a6c18164d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:44.363516 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2483f77-eeb2-4790-9adf-791a6c18164d None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:44.365096 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 438/887] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:44.371813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d5c2c-0de0-4f60-8197-b6b47735c8cb None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:44.372152 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d5c2c-0de0-4f60-8197-b6b47735c8cb None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:44.372416 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d5c2c-0de0-4f60-8197-b6b47735c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:44.377524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4a82d-20c3-43b8-a445-dd19005a9445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:44.379287 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4a82d-20c3-43b8-a445-dd19005a9445 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:44.380091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4a82d-20c3-43b8-a445-dd19005a9445 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:44.380724 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4a82d-20c3-43b8-a445-dd19005a9445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:44.392506 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-841d5c2c-0de0-4f60-8197-b6b47735c8cb None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:44.394108 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-841d5c2c-0de0-4f60-8197-b6b47735c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:44.478015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4a82d-20c3-43b8-a445-dd19005a9445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:44.479504 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4a82d-20c3-43b8-a445-dd19005a9445 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:44.497410 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 439/888] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:41:44.497968 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d5c2c-0de0-4f60-8197-b6b47735c8cb None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:44.503853 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:44.626088 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d5c2c-0de0-4f60-8197-b6b47735c8cb None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:44.636424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:44.640855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 450/889] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:44 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 13:41:44.641955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4a82d-20c3-43b8-a445-dd19005a9445 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:44.683995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab4966-6177-4852-a208-c6f0ead158cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:44.684837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4966-6177-4852-a208-c6f0ead158cd None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:44.685118 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4966-6177-4852-a208-c6f0ead158cd None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:44.685391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4966-6177-4852-a208-c6f0ead158cd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:44.686176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab4966-6177-4852-a208-c6f0ead158cd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:44.687450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab4966-6177-4852-a208-c6f0ead158cd None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-f0ab4966-6177-4852-a208-c6f0ead158cd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:44.700810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:44.704545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:44.705420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 440/890] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:41:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:44.706213 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab4966-6177-4852-a208-c6f0ead158cd None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:44.763952 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4a82d-20c3-43b8-a445-dd19005a9445 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:44.777784 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:44.807758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c1476-c766-41d3-bd4d-77b4b54b1dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:44.808987 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c1476-c766-41d3-bd4d-77b4b54b1dc8 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:44.809346 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c1476-c766-41d3-bd4d-77b4b54b1dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:44.809702 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c1476-c766-41d3-bd4d-77b4b54b1dc8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:44.810452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c1476-c766-41d3-bd4d-77b4b54b1dc8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:44.811876 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c1476-c766-41d3-bd4d-77b4b54b1dc8 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-3b1c1476-c766-41d3-bd4d-77b4b54b1dc8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:44.825368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:44.826458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:44.827281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 451/891] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 13:41:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:44.828088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c1476-c766-41d3-bd4d-77b4b54b1dc8 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:44.850658 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab4966-6177-4852-a208-c6f0ead158cd None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:44.892038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1255aa0-e6ad-47de-a223-f2e7b2644e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:44.892751 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1255aa0-e6ad-47de-a223-f2e7b2644e72 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:44.893059 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1255aa0-e6ad-47de-a223-f2e7b2644e72 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:44.893331 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1255aa0-e6ad-47de-a223-f2e7b2644e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:44.906661 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1255aa0-e6ad-47de-a223-f2e7b2644e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:44.908153 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1255aa0-e6ad-47de-a223-f2e7b2644e72 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-a1255aa0-e6ad-47de-a223-f2e7b2644e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:44.926808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:44.928078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:44.931000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:44.931000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:44.931000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:44.931000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:44.931000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 441/892] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:44.931000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1255aa0-e6ad-47de-a223-f2e7b2644e72 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:44.962826 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:44.992027 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c1476-c766-41d3-bd4d-77b4b54b1dc8 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:45.038188 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e5e56-00fd-4d12-8fc8-ef705d09c04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:45.038867 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e5e56-00fd-4d12-8fc8-ef705d09c04a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:45.039183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e5e56-00fd-4d12-8fc8-ef705d09c04a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:45.039473 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e5e56-00fd-4d12-8fc8-ef705d09c04a None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:45.040347 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e5e56-00fd-4d12-8fc8-ef705d09c04a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:45.040552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e5e56-00fd-4d12-8fc8-ef705d09c04a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:45.041954 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e5e56-00fd-4d12-8fc8-ef705d09c04a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:45.052251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 452/893] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:41:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:45.052251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e5e56-00fd-4d12-8fc8-ef705d09c04a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:45.086125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1255aa0-e6ad-47de-a223-f2e7b2644e72 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:45.104735 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:45.131041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3964a45-c2e4-419f-bf97-ad0f8307dfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:45.131833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3964a45-c2e4-419f-bf97-ad0f8307dfca None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:45.132221 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3964a45-c2e4-419f-bf97-ad0f8307dfca None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:45.132517 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3964a45-c2e4-419f-bf97-ad0f8307dfca None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:45.133905 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3964a45-c2e4-419f-bf97-ad0f8307dfca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:45.134220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3964a45-c2e4-419f-bf97-ad0f8307dfca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:45.135631 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3964a45-c2e4-419f-bf97-ad0f8307dfca None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:45.141340 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 442/894] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 13:41:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:45.142269 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3964a45-c2e4-419f-bf97-ad0f8307dfca None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:45.196704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e5e56-00fd-4d12-8fc8-ef705d09c04a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:45.247930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5aa08-c11d-4345-8683-3b5802c59318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:45.249113 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5aa08-c11d-4345-8683-3b5802c59318 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:45.249829 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5aa08-c11d-4345-8683-3b5802c59318 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:45.250343 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5aa08-c11d-4345-8683-3b5802c59318 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:45.251961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5aa08-c11d-4345-8683-3b5802c59318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:45.252612 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5aa08-c11d-4345-8683-3b5802c59318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:45.255564 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5aa08-c11d-4345-8683-3b5802c59318 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:45.269973 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:45.283090 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 453/895] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:45.283090 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5aa08-c11d-4345-8683-3b5802c59318 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:45.308198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3964a45-c2e4-419f-bf97-ad0f8307dfca None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:45.356756 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714e795-aec0-4130-8c78-9488bad06f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:45.357423 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714e795-aec0-4130-8c78-9488bad06f08 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:45.357705 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714e795-aec0-4130-8c78-9488bad06f08 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:45.357978 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714e795-aec0-4130-8c78-9488bad06f08 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:45.358943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714e795-aec0-4130-8c78-9488bad06f08 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:45.359051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714e795-aec0-4130-8c78-9488bad06f08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:45.360389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714e795-aec0-4130-8c78-9488bad06f08 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:45.366130 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 443/896] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:41:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:45.369703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714e795-aec0-4130-8c78-9488bad06f08 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:45.445738 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:45.451999 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5aa08-c11d-4345-8683-3b5802c59318 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:45.520536 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdc366-7636-46a4-aec2-64e99c44fd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:45.521290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdc366-7636-46a4-aec2-64e99c44fd62 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:45.521622 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdc366-7636-46a4-aec2-64e99c44fd62 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:45.521947 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdc366-7636-46a4-aec2-64e99c44fd62 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:45.522824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdc366-7636-46a4-aec2-64e99c44fd62 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:45.523177 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdc366-7636-46a4-aec2-64e99c44fd62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:45.525311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdc366-7636-46a4-aec2-64e99c44fd62 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:45.528017 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714e795-aec0-4130-8c78-9488bad06f08 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:45.531179 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 454/897] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 13:41:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:45.532387 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdc366-7636-46a4-aec2-64e99c44fd62 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:45.588729 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da93f7-b2ab-4de4-affb-3f0fa34819cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:45.589871 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da93f7-b2ab-4de4-affb-3f0fa34819cb None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:45.590152 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da93f7-b2ab-4de4-affb-3f0fa34819cb None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:45.590430 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da93f7-b2ab-4de4-affb-3f0fa34819cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:45.603486 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da93f7-b2ab-4de4-affb-3f0fa34819cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:45.605356 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da93f7-b2ab-4de4-affb-3f0fa34819cb None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-11da93f7-b2ab-4de4-affb-3f0fa34819cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:45.622858 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:45.623987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:45.625220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:45.625220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:45.625220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:45.625220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:45.625220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:45.625220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:45.625220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:45.625220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:45.625220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 444/898] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:45.632588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da93f7-b2ab-4de4-affb-3f0fa34819cb None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:45.648152 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:45.684159 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdc366-7636-46a4-aec2-64e99c44fd62 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:45.726033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac7acd-bfd8-46ae-9960-ecff0a3cac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:45.727662 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac7acd-bfd8-46ae-9960-ecff0a3cac42 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:45.727662 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac7acd-bfd8-46ae-9960-ecff0a3cac42 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:45.728007 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac7acd-bfd8-46ae-9960-ecff0a3cac42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:45.728770 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac7acd-bfd8-46ae-9960-ecff0a3cac42 None admin] RBAC: Adding query filter params (interface=public, service_id=8506cdfefb4449549967d5bf9698d950, region_id=RegionOne) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:45.729117 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac7acd-bfd8-46ae-9960-ecff0a3cac42 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:45.730677 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac7acd-bfd8-46ae-9960-ecff0a3cac42 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:45.745479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 455/899] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 13:41:45 2022] GET /identity/v3/endpoints?service_id=8506cdfefb4449549967d5bf9698d950&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:45.748765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac7acd-bfd8-46ae-9960-ecff0a3cac42 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:45.784208 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da93f7-b2ab-4de4-affb-3f0fa34819cb None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:45.795761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:45.839334 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8c16a-03ff-45e4-a269-4eb897df6ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:45.840286 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8c16a-03ff-45e4-a269-4eb897df6ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:45.840449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8c16a-03ff-45e4-a269-4eb897df6ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:45.840691 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8c16a-03ff-45e4-a269-4eb897df6ff7 None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:45.841555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8c16a-03ff-45e4-a269-4eb897df6ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:45.841876 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8c16a-03ff-45e4-a269-4eb897df6ff7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:45.844160 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8c16a-03ff-45e4-a269-4eb897df6ff7 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:45.864224 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 445/900] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:45.867036 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8c16a-03ff-45e4-a269-4eb897df6ff7 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:45.934721 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac7acd-bfd8-46ae-9960-ecff0a3cac42 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:45.982868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab8e7d-1721-442b-ae91-39e50c0fe304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:45.983833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab8e7d-1721-442b-ae91-39e50c0fe304 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:45.984305 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab8e7d-1721-442b-ae91-39e50c0fe304 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:45.984733 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab8e7d-1721-442b-ae91-39e50c0fe304 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:45.985960 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab8e7d-1721-442b-ae91-39e50c0fe304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:45.987591 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab8e7d-1721-442b-ae91-39e50c0fe304 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:45.988439 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:45.996542 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 456/901] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 13:41:45 2022] GET /identity/v3/services => generated 1268 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:41:46.033257 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8c16a-03ff-45e4-a269-4eb897df6ff7 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:46.077091 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff684d34-feca-4282-9a5c-e38b30654301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:46.078260 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff684d34-feca-4282-9a5c-e38b30654301 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:46.078778 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff684d34-feca-4282-9a5c-e38b30654301 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:46.079342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff684d34-feca-4282-9a5c-e38b30654301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:46.080556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff684d34-feca-4282-9a5c-e38b30654301 None admin] RBAC: Adding query filter params (role.id=53a0e5251cb44b8aa29d218cd5a19860, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=b1e5039385f44bb2b52e795524d6b8d2) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:46.081111 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff684d34-feca-4282-9a5c-e38b30654301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:46.082847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff684d34-feca-4282-9a5c-e38b30654301 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:46.090299 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 446/902] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:45 2022] GET /identity/v3/role_assignments?user.id=b1e5039385f44bb2b52e795524d6b8d2&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=53a0e5251cb44b8aa29d218cd5a19860 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:46.406711 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202d98d-7830-4efb-8b64-d4ebdd2e422a None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:46.407096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202d98d-7830-4efb-8b64-d4ebdd2e422a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:46.407475 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202d98d-7830-4efb-8b64-d4ebdd2e422a None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:46.409480 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 457/903] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:46.417393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff02e4-c9a2-4655-b1de-5bc33e356346 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:46.417733 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff02e4-c9a2-4655-b1de-5bc33e356346 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:46.417969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff02e4-c9a2-4655-b1de-5bc33e356346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:46.438681 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-abff02e4-c9a2-4655-b1de-5bc33e356346 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:46.440018 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-abff02e4-c9a2-4655-b1de-5bc33e356346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:46.519876 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 447/904] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:46.545175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202d98d-7830-4efb-8b64-d4ebdd2e422a None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:46.668289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:46.682204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202d98d-7830-4efb-8b64-d4ebdd2e422a None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:46.728382 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e63e52-7e94-48ae-85f2-0b2dbd8165f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:46.729226 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e63e52-7e94-48ae-85f2-0b2dbd8165f2 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:46.729513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e63e52-7e94-48ae-85f2-0b2dbd8165f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:46.729830 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e63e52-7e94-48ae-85f2-0b2dbd8165f2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:46.730509 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e63e52-7e94-48ae-85f2-0b2dbd8165f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:46.731920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e63e52-7e94-48ae-85f2-0b2dbd8165f2 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-66e63e52-7e94-48ae-85f2-0b2dbd8165f2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:46.748043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:46.749057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:46.749971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 458/905] 10.222.0.24 () {56 vars in 1132 bytes} [Wed May 25 13:41:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:46.759910 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff02e4-c9a2-4655-b1de-5bc33e356346 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:46.838202 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:46.880489 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff02e4-c9a2-4655-b1de-5bc33e356346 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:46.921823 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f0c23-bb8d-4856-8df8-1d7aad60219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:46.922474 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f0c23-bb8d-4856-8df8-1d7aad60219c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:46.922788 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f0c23-bb8d-4856-8df8-1d7aad60219c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:46.923108 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f0c23-bb8d-4856-8df8-1d7aad60219c None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:46.923893 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f0c23-bb8d-4856-8df8-1d7aad60219c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:46.924250 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f0c23-bb8d-4856-8df8-1d7aad60219c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:46.925875 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f0c23-bb8d-4856-8df8-1d7aad60219c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:46.933098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 448/906] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 13:41:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:46.939542 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e63e52-7e94-48ae-85f2-0b2dbd8165f2 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:47.090025 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e63e52-7e94-48ae-85f2-0b2dbd8165f2 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:47.128337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb29cb-0305-46d4-9c56-3d3e446c20ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:47.129059 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb29cb-0305-46d4-9c56-3d3e446c20ba None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:47.129339 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb29cb-0305-46d4-9c56-3d3e446c20ba None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:47.129634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb29cb-0305-46d4-9c56-3d3e446c20ba None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:47.130320 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb29cb-0305-46d4-9c56-3d3e446c20ba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:47.130655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb29cb-0305-46d4-9c56-3d3e446c20ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:47.132021 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb29cb-0305-46d4-9c56-3d3e446c20ba None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:47.137895 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 459/907] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 13:41:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:47.148946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f0c23-bb8d-4856-8df8-1d7aad60219c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:47.353551 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f0c23-bb8d-4856-8df8-1d7aad60219c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:47.388629 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:47.399956 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24f988-c39d-4edf-ac1c-735ee19bae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:47.400805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24f988-c39d-4edf-ac1c-735ee19bae3c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:47.401140 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24f988-c39d-4edf-ac1c-735ee19bae3c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:47.401391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24f988-c39d-4edf-ac1c-735ee19bae3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:47.402189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24f988-c39d-4edf-ac1c-735ee19bae3c None admin] RBAC: Adding query filter params (interface=public, service_id=fcc03a516070457caabde32fec0d2fb0, region_id=RegionOne) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:47.402507 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24f988-c39d-4edf-ac1c-735ee19bae3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:47.404253 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24f988-c39d-4edf-ac1c-735ee19bae3c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:47.411119 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 449/908] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 13:41:47 2022] GET /identity/v3/endpoints?service_id=fcc03a516070457caabde32fec0d2fb0&interface=public®ion_id=RegionOne => generated 194 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:47.421367 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb29cb-0305-46d4-9c56-3d3e446c20ba None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:47.461552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:47.589162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb29cb-0305-46d4-9c56-3d3e446c20ba None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:47.631791 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015caed3-cf80-44ba-bf8a-d5630091d0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:47.632563 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015caed3-cf80-44ba-bf8a-d5630091d0fb None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:47.633402 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015caed3-cf80-44ba-bf8a-d5630091d0fb None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:47.633697 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015caed3-cf80-44ba-bf8a-d5630091d0fb None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:47.634448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015caed3-cf80-44ba-bf8a-d5630091d0fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:47.635978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015caed3-cf80-44ba-bf8a-d5630091d0fb None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:47.643275 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 460/909] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 13:41:47 2022] GET /identity/v3/services => generated 1268 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:41:48.323266 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c7cae-fc91-4e9b-8aeb-976f0b17c688 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:48.323796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c7cae-fc91-4e9b-8aeb-976f0b17c688 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:48.324027 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c7cae-fc91-4e9b-8aeb-976f0b17c688 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:48.325810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 450/910] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:48.332077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee39fd5-88e4-465f-8054-93bc25ccecae None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:48.332774 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee39fd5-88e4-465f-8054-93bc25ccecae None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:48.332774 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee39fd5-88e4-465f-8054-93bc25ccecae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:48.352732 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-eee39fd5-88e4-465f-8054-93bc25ccecae None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:48.353985 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-eee39fd5-88e4-465f-8054-93bc25ccecae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:48.454343 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 461/911] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:48.478683 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c7cae-fc91-4e9b-8aeb-976f0b17c688 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:48.607983 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c7cae-fc91-4e9b-8aeb-976f0b17c688 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:48.629303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8cab6-23dd-4bfd-a885-46c43506e12d None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:48.629632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8cab6-23dd-4bfd-a885-46c43506e12d None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:48.629845 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8cab6-23dd-4bfd-a885-46c43506e12d None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:48.631817 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 462/912] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:48.638723 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf17cdf-6e39-4599-b679-5ef8d11eb6e2 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:48.639021 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf17cdf-6e39-4599-b679-5ef8d11eb6e2 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:48.639269 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf17cdf-6e39-4599-b679-5ef8d11eb6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:48.655799 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8746b-387e-46a5-b323-58fc009800d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:48.656554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8746b-387e-46a5-b323-58fc009800d8 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:48.656838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8746b-387e-46a5-b323-58fc009800d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:48.657117 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8746b-387e-46a5-b323-58fc009800d8 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:48.657904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8746b-387e-46a5-b323-58fc009800d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:48.659490 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8746b-387e-46a5-b323-58fc009800d8 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:48.664673 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-3cf17cdf-6e39-4599-b679-5ef8d11eb6e2 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:48.666311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-3cf17cdf-6e39-4599-b679-5ef8d11eb6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:48.676845 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:48.684520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 451/913] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:41:48 2022] POST /identity/v3/services => generated 241 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:41:48.752808 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505f0dc-ec00-4be4-9b19-e49b93d4c3bf None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:48.753598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505f0dc-ec00-4be4-9b19-e49b93d4c3bf None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:48.754397 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505f0dc-ec00-4be4-9b19-e49b93d4c3bf None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:48.767560 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 452/914] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:48.775837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdda1ba-754f-47a0-a7b2-5464547708f6 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:48.776601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdda1ba-754f-47a0-a7b2-5464547708f6 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:48.777299 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdda1ba-754f-47a0-a7b2-5464547708f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:48.797288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 463/915] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:41:48.802239 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-dbdda1ba-754f-47a0-a7b2-5464547708f6 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:48.804302 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-dbdda1ba-754f-47a0-a7b2-5464547708f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:48.824693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf17cdf-6e39-4599-b679-5ef8d11eb6e2 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:48.875242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:48.908272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 453/916] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:41:48.930891 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdda1ba-754f-47a0-a7b2-5464547708f6 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:48.969765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf17cdf-6e39-4599-b679-5ef8d11eb6e2 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:49.015558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43407e-662c-4a65-93fa-952539d7fdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:49.016428 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43407e-662c-4a65-93fa-952539d7fdc5 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:49.016709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43407e-662c-4a65-93fa-952539d7fdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:49.016986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43407e-662c-4a65-93fa-952539d7fdc5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:49.027613 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:49.032886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43407e-662c-4a65-93fa-952539d7fdc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-3c43407e-662c-4a65-93fa-952539d7fdc5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:49.045725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:49.046850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:49.047799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:49.047799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:49.047799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:49.047799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:49.047799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:49.047799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:49.047799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:49.047799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:49.047799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:49.047799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:49.047799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:41:49.047799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:49.049022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 464/917] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 13:41:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:49.057182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43407e-662c-4a65-93fa-952539d7fdc5 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:49.082895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdda1ba-754f-47a0-a7b2-5464547708f6 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:49.125674 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e074b3-2eef-422a-9068-690b7284f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:49.126854 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e074b3-2eef-422a-9068-690b7284f87a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:49.127350 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e074b3-2eef-422a-9068-690b7284f87a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:49.127905 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e074b3-2eef-422a-9068-690b7284f87a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:49.128872 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e074b3-2eef-422a-9068-690b7284f87a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:49.130530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e074b3-2eef-422a-9068-690b7284f87a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-05e074b3-2eef-422a-9068-690b7284f87a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:49.143985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:49.145261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:41:49.146282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:49.148803 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 454/918] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:41:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:49.160233 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e074b3-2eef-422a-9068-690b7284f87a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:49.190575 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43407e-662c-4a65-93fa-952539d7fdc5 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:49.229117 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:49.255108 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddde20b-e709-4dbb-b0b8-37fafbd0d40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:49.255962 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddde20b-e709-4dbb-b0b8-37fafbd0d40a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:49.256303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddde20b-e709-4dbb-b0b8-37fafbd0d40a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:49.256844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddde20b-e709-4dbb-b0b8-37fafbd0d40a None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:49.257353 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddde20b-e709-4dbb-b0b8-37fafbd0d40a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:49.257965 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddde20b-e709-4dbb-b0b8-37fafbd0d40a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:49.259130 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddde20b-e709-4dbb-b0b8-37fafbd0d40a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:49.275695 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 465/919] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 13:41:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:49.277248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddde20b-e709-4dbb-b0b8-37fafbd0d40a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:49.313485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e074b3-2eef-422a-9068-690b7284f87a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:49.360105 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fffd15-a52a-4486-b7e6-31667b657d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:49.361671 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fffd15-a52a-4486-b7e6-31667b657d23 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:49.362483 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fffd15-a52a-4486-b7e6-31667b657d23 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:49.363064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fffd15-a52a-4486-b7e6-31667b657d23 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:49.364048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fffd15-a52a-4486-b7e6-31667b657d23 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:49.364530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fffd15-a52a-4486-b7e6-31667b657d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:49.366767 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fffd15-a52a-4486-b7e6-31667b657d23 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:49.367841 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:49.374366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 455/920] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:41:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:49.386437 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fffd15-a52a-4486-b7e6-31667b657d23 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:49.451274 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddde20b-e709-4dbb-b0b8-37fafbd0d40a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:49.496785 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9857b1-19e6-4950-b79e-7947e01a5239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:49.498010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9857b1-19e6-4950-b79e-7947e01a5239 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:49.498855 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9857b1-19e6-4950-b79e-7947e01a5239 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:49.499288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9857b1-19e6-4950-b79e-7947e01a5239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:49.516477 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9857b1-19e6-4950-b79e-7947e01a5239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:49.518405 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9857b1-19e6-4950-b79e-7947e01a5239 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:49.529811 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fffd15-a52a-4486-b7e6-31667b657d23 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-9b9857b1-19e6-4950-b79e-7947e01a5239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:49.540396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:49.541727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:49.542833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:49.542833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:49.542833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:49.542833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:49.546673 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 466/921] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:49.547471 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:49.549360 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9857b1-19e6-4950-b79e-7947e01a5239 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:49.578496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2bacf-3ae1-4fb2-9a41-8ecf19c4fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:49.579373 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2bacf-3ae1-4fb2-9a41-8ecf19c4fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:49.579712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2bacf-3ae1-4fb2-9a41-8ecf19c4fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:49.580096 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2bacf-3ae1-4fb2-9a41-8ecf19c4fcf8 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:49.580957 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2bacf-3ae1-4fb2-9a41-8ecf19c4fcf8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:49.581426 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2bacf-3ae1-4fb2-9a41-8ecf19c4fcf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:49.583147 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2bacf-3ae1-4fb2-9a41-8ecf19c4fcf8 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:49.590535 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 456/922] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 13:41:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:49.597757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2bacf-3ae1-4fb2-9a41-8ecf19c4fcf8 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:49.670238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9857b1-19e6-4950-b79e-7947e01a5239 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:49.691751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:49.737433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd58a9-ab75-403e-9101-5a9c1cb78bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:49.738613 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd58a9-ab75-403e-9101-5a9c1cb78bba None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:49.739084 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd58a9-ab75-403e-9101-5a9c1cb78bba None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:49.739370 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd58a9-ab75-403e-9101-5a9c1cb78bba None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:49.740396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd58a9-ab75-403e-9101-5a9c1cb78bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:49.740811 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd58a9-ab75-403e-9101-5a9c1cb78bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:49.743223 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd58a9-ab75-403e-9101-5a9c1cb78bba None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:49.761305 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 467/923] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:49.768385 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd58a9-ab75-403e-9101-5a9c1cb78bba None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:49.777104 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2bacf-3ae1-4fb2-9a41-8ecf19c4fcf8 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:49.834008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ea60f-a81d-4b96-b286-8bb3290bb427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:49.835170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ea60f-a81d-4b96-b286-8bb3290bb427 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:49.835653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ea60f-a81d-4b96-b286-8bb3290bb427 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:49.836190 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ea60f-a81d-4b96-b286-8bb3290bb427 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:49.837663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ea60f-a81d-4b96-b286-8bb3290bb427 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:49.840322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ea60f-a81d-4b96-b286-8bb3290bb427 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:49.885642 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 457/924] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 13:41:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:41:49.976199 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd58a9-ab75-403e-9101-5a9c1cb78bba None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:50.064848 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dae4a-d86a-4be0-bdca-cabc80a4b5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:50.066301 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dae4a-d86a-4be0-bdca-cabc80a4b5b5 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:50.066809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dae4a-d86a-4be0-bdca-cabc80a4b5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:50.067316 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dae4a-d86a-4be0-bdca-cabc80a4b5b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:50.083568 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dae4a-d86a-4be0-bdca-cabc80a4b5b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:50.087053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dae4a-d86a-4be0-bdca-cabc80a4b5b5 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-a37dae4a-d86a-4be0-bdca-cabc80a4b5b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:50.118868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:50.120409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:50.121610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:50.121610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:50.121610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:50.121610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:50.121610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:50.121610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:50.121610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:50.121610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:50.121610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:41:50.121610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:50.122493 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 468/925] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 13:41:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:50.130839 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ea60f-a81d-4b96-b286-8bb3290bb427 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:50.173063 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:50.266078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ea60f-a81d-4b96-b286-8bb3290bb427 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:50.305972 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5dcd7-28d3-484c-9f57-93e91dc3f118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:50.306813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5dcd7-28d3-484c-9f57-93e91dc3f118 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:50.307098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5dcd7-28d3-484c-9f57-93e91dc3f118 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:50.307433 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5dcd7-28d3-484c-9f57-93e91dc3f118 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:50.308451 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5dcd7-28d3-484c-9f57-93e91dc3f118 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:50.308764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5dcd7-28d3-484c-9f57-93e91dc3f118 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:50.310256 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5dcd7-28d3-484c-9f57-93e91dc3f118 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:50.330936 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 458/926] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 13:41:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:50.337810 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dae4a-d86a-4be0-bdca-cabc80a4b5b5 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:50.372964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:50.380672 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce46a33-23c2-49b4-a0f3-e61348109ff1 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:50.381198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce46a33-23c2-49b4-a0f3-e61348109ff1 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:50.381393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce46a33-23c2-49b4-a0f3-e61348109ff1 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:50.384145 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 459/927] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:41:50.390514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe1426-8a60-4f40-ad2c-0de2f2fdad0d None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:50.390892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe1426-8a60-4f40-ad2c-0de2f2fdad0d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:50.391232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe1426-8a60-4f40-ad2c-0de2f2fdad0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:50.411394 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-28fe1426-8a60-4f40-ad2c-0de2f2fdad0d None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:50.413120 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-28fe1426-8a60-4f40-ad2c-0de2f2fdad0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:50.474246 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dae4a-d86a-4be0-bdca-cabc80a4b5b5 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:50.505837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 460/928] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:50.529488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5af36c-582c-48b6-90c5-1c88cc1c5406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:50.530715 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5af36c-582c-48b6-90c5-1c88cc1c5406 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:50.531238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5af36c-582c-48b6-90c5-1c88cc1c5406 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:50.531897 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5af36c-582c-48b6-90c5-1c88cc1c5406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:50.536210 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe1426-8a60-4f40-ad2c-0de2f2fdad0d None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:50.558086 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5af36c-582c-48b6-90c5-1c88cc1c5406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:50.560567 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5af36c-582c-48b6-90c5-1c88cc1c5406 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:50.566456 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-6c5af36c-582c-48b6-90c5-1c88cc1c5406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:50.590783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:50.591783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:50.592749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:50.592749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:50.592749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:50.592749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:50.595434 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 469/929] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:50.602454 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5af36c-582c-48b6-90c5-1c88cc1c5406 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:50.681890 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe1426-8a60-4f40-ad2c-0de2f2fdad0d None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:50.756057 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a62e8b-0a1e-4da9-8f0c-79e8c71d6727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:50.757167 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a62e8b-0a1e-4da9-8f0c-79e8c71d6727 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:50.758114 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a62e8b-0a1e-4da9-8f0c-79e8c71d6727 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:50.758513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a62e8b-0a1e-4da9-8f0c-79e8c71d6727 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:50.759347 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:50.760465 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a62e8b-0a1e-4da9-8f0c-79e8c71d6727 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:50.763247 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a62e8b-0a1e-4da9-8f0c-79e8c71d6727 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-96a62e8b-0a1e-4da9-8f0c-79e8c71d6727 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:50.782860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:50.784051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:50.785406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 461/930] 10.222.0.24 () {56 vars in 1132 bytes} [Wed May 25 13:41:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:50.790607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a62e8b-0a1e-4da9-8f0c-79e8c71d6727 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:50.790954 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5af36c-582c-48b6-90c5-1c88cc1c5406 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:50.846719 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb61d59-a729-4277-a5fb-f465df627caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:50.848141 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61d59-a729-4277-a5fb-f465df627caf None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:50.848666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61d59-a729-4277-a5fb-f465df627caf None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:50.849345 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61d59-a729-4277-a5fb-f465df627caf None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:50.850298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb61d59-a729-4277-a5fb-f465df627caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:50.850852 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb61d59-a729-4277-a5fb-f465df627caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:50.854046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb61d59-a729-4277-a5fb-f465df627caf None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:50.873301 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 470/931] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:50.879393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb61d59-a729-4277-a5fb-f465df627caf None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:50.915451 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:50.948304 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a62e8b-0a1e-4da9-8f0c-79e8c71d6727 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:51.004292 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f41009-257c-4663-a6c8-439bedfafe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:51.005159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f41009-257c-4663-a6c8-439bedfafe32 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:51.005530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f41009-257c-4663-a6c8-439bedfafe32 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:51.005912 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f41009-257c-4663-a6c8-439bedfafe32 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:51.007056 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f41009-257c-4663-a6c8-439bedfafe32 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:51.007548 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f41009-257c-4663-a6c8-439bedfafe32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:51.009806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f41009-257c-4663-a6c8-439bedfafe32 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:51.017162 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 462/932] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 13:41:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:51.022248 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f41009-257c-4663-a6c8-439bedfafe32 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:51.033464 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb61d59-a729-4277-a5fb-f465df627caf None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:51.086241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a73ac-d011-499f-b44b-2576d974a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:51.087752 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a73ac-d011-499f-b44b-2576d974a8ea None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:51.088297 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a73ac-d011-499f-b44b-2576d974a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:51.088802 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a73ac-d011-499f-b44b-2576d974a8ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:51.099530 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a73ac-d011-499f-b44b-2576d974a8ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:51.102579 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a73ac-d011-499f-b44b-2576d974a8ea None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:51.108038 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-246a73ac-d011-499f-b44b-2576d974a8ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:51.128324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:51.129285 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:51.130372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:51.130372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:51.130372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:51.130372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:51.130372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:51.130372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:51.130372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:51.130372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:51.133065 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 471/933] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:51.141281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a73ac-d011-499f-b44b-2576d974a8ea None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:51.184910 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f41009-257c-4663-a6c8-439bedfafe32 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:51.228361 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2bdc5-008d-48eb-8e03-ac0c57d7ccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:51.229192 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2bdc5-008d-48eb-8e03-ac0c57d7ccba None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:51.229542 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2bdc5-008d-48eb-8e03-ac0c57d7ccba None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:51.229888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2bdc5-008d-48eb-8e03-ac0c57d7ccba None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:51.230779 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2bdc5-008d-48eb-8e03-ac0c57d7ccba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:51.231189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2bdc5-008d-48eb-8e03-ac0c57d7ccba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:51.232863 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2bdc5-008d-48eb-8e03-ac0c57d7ccba None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:51.246622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 463/934] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 13:41:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:51.246622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fe3a6-a7fd-4f82-92ea-d5cc3f588ffe None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:51.246622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fe3a6-a7fd-4f82-92ea-d5cc3f588ffe None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:51.246622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fe3a6-a7fd-4f82-92ea-d5cc3f588ffe None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:51.246622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 464/935] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:51.248083 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fe3a6-a7fd-4f82-92ea-d5cc3f588ffe None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:51.263079 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:51.282053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a73ac-d011-499f-b44b-2576d974a8ea None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:51.335219 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcc0d0-20e4-4b47-ad5f-e1fa838dc2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:51.336480 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcc0d0-20e4-4b47-ad5f-e1fa838dc2b1 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:51.336961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcc0d0-20e4-4b47-ad5f-e1fa838dc2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:51.337389 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcc0d0-20e4-4b47-ad5f-e1fa838dc2b1 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:51.338198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcc0d0-20e4-4b47-ad5f-e1fa838dc2b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:51.338580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcc0d0-20e4-4b47-ad5f-e1fa838dc2b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:51.340070 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcc0d0-20e4-4b47-ad5f-e1fa838dc2b1 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:51.359946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 472/936] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:51.359946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363264ba-3137-48ec-972d-c4ada65b8489 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:51.359946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363264ba-3137-48ec-972d-c4ada65b8489 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:51.359946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363264ba-3137-48ec-972d-c4ada65b8489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:51.377643 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-363264ba-3137-48ec-972d-c4ada65b8489 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:51.379178 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-363264ba-3137-48ec-972d-c4ada65b8489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:51.388471 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fe3a6-a7fd-4f82-92ea-d5cc3f588ffe None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:51.454098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121bba7-c43b-45ee-a75b-9efa88adc269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:51.455008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121bba7-c43b-45ee-a75b-9efa88adc269 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:51.455417 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:51.455529 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121bba7-c43b-45ee-a75b-9efa88adc269 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:51.455812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121bba7-c43b-45ee-a75b-9efa88adc269 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:51.457689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121bba7-c43b-45ee-a75b-9efa88adc269 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:51.460023 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121bba7-c43b-45ee-a75b-9efa88adc269 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:51.472585 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 473/937] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:51.473595 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363264ba-3137-48ec-972d-c4ada65b8489 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:51.485178 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 465/938] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 13:41:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:41:51.520288 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121bba7-c43b-45ee-a75b-9efa88adc269 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:51.662514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:51.690794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363264ba-3137-48ec-972d-c4ada65b8489 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:51.732087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121bba7-c43b-45ee-a75b-9efa88adc269 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:51.767696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2e047-3251-470f-b409-b88e5b2e3107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:51.769629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e047-3251-470f-b409-b88e5b2e3107 None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:51.770138 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e047-3251-470f-b409-b88e5b2e3107 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:51.770653 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e047-3251-470f-b409-b88e5b2e3107 None admin] PATH_INFO: `/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/b1e5039385f44bb2b52e795524d6b8d2/roles/53a0e5251cb44b8aa29d218cd5a19860` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:51.775871 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2e047-3251-470f-b409-b88e5b2e3107 None admin] RBAC: Authorizing `identity:create_grant(project_id=b57fe974dc4d4542a1dd930fc6912d39, user_id=b1e5039385f44bb2b52e795524d6b8d2, role_id=53a0e5251cb44b8aa29d218cd5a19860)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:51.778617 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2e047-3251-470f-b409-b88e5b2e3107 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:51.786804 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600590b7-122b-4699-81d1-a03f6a36e759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:51.788656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600590b7-122b-4699-81d1-a03f6a36e759 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:51.789635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600590b7-122b-4699-81d1-a03f6a36e759 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:51.790242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600590b7-122b-4699-81d1-a03f6a36e759 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:51.791167 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600590b7-122b-4699-81d1-a03f6a36e759 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:51.792872 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600590b7-122b-4699-81d1-a03f6a36e759 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:51.805819 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 474/939] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:41:51 2022] PUT /identity/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/b1e5039385f44bb2b52e795524d6b8d2/roles/53a0e5251cb44b8aa29d218cd5a19860 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-600590b7-122b-4699-81d1-a03f6a36e759 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:51.806759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:51.808746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:41:51.811022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:51.819916 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 466/940] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 13:41:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:51.826261 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2e047-3251-470f-b409-b88e5b2e3107 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:51.929891 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:52.021628 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2e047-3251-470f-b409-b88e5b2e3107 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:52.073178 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d2d3d-dc86-4fea-b31d-289a128d5db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:52.074165 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d2d3d-dc86-4fea-b31d-289a128d5db7 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:52.074610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d2d3d-dc86-4fea-b31d-289a128d5db7 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:52.074882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d2d3d-dc86-4fea-b31d-289a128d5db7 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:52.075710 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d2d3d-dc86-4fea-b31d-289a128d5db7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:52.076022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d2d3d-dc86-4fea-b31d-289a128d5db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:52.077594 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d2d3d-dc86-4fea-b31d-289a128d5db7 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:52.084498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 475/941] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 13:41:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:52.093284 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600590b7-122b-4699-81d1-a03f6a36e759 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:52.215163 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600590b7-122b-4699-81d1-a03f6a36e759 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:52.252327 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:52.255260 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9dd5d-c279-4d26-bf4b-b903f3287891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:52.255994 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9dd5d-c279-4d26-bf4b-b903f3287891 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:52.256874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9dd5d-c279-4d26-bf4b-b903f3287891 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:52.257238 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9dd5d-c279-4d26-bf4b-b903f3287891 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:52.258922 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9dd5d-c279-4d26-bf4b-b903f3287891 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:52.259724 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9dd5d-c279-4d26-bf4b-b903f3287891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:52.261607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9dd5d-c279-4d26-bf4b-b903f3287891 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:52.268009 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 467/942] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 13:41:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:52.275251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d2d3d-dc86-4fea-b31d-289a128d5db7 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:52.419562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d2d3d-dc86-4fea-b31d-289a128d5db7 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:52.438426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:52.463981 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67884004-2f42-4a8e-8f30-9f79fd83a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:52.465411 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67884004-2f42-4a8e-8f30-9f79fd83a2b3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:52.465911 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67884004-2f42-4a8e-8f30-9f79fd83a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:52.466408 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67884004-2f42-4a8e-8f30-9f79fd83a2b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:52.467433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67884004-2f42-4a8e-8f30-9f79fd83a2b3 None admin] RBAC: Adding query filter params (interface=public, service_id=56c58f9f68bb4d0e967abc670f2a3954, region_id=RegionOne) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:52.467957 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67884004-2f42-4a8e-8f30-9f79fd83a2b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:52.469602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67884004-2f42-4a8e-8f30-9f79fd83a2b3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:52.477584 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 476/943] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 13:41:52 2022] GET /identity/v3/endpoints?service_id=56c58f9f68bb4d0e967abc670f2a3954&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:52.484537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9dd5d-c279-4d26-bf4b-b903f3287891 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:52.536631 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426e028-239c-4fd7-94e2-d6ff13bc35f8 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:52.537383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426e028-239c-4fd7-94e2-d6ff13bc35f8 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:52.537887 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426e028-239c-4fd7-94e2-d6ff13bc35f8 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:52.540698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 477/944] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:52.547109 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5abdd-ee2a-4039-a2dd-809636f488e0 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:52.547796 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5abdd-ee2a-4039-a2dd-809636f488e0 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:52.548418 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5abdd-ee2a-4039-a2dd-809636f488e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:52.569366 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-19f5abdd-ee2a-4039-a2dd-809636f488e0 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:52.571298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-19f5abdd-ee2a-4039-a2dd-809636f488e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:52.611948 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9dd5d-c279-4d26-bf4b-b903f3287891 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:52.651938 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386fcfc-b663-43ad-b563-535a088a4793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:52.652742 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386fcfc-b663-43ad-b563-535a088a4793 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:52.653035 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386fcfc-b663-43ad-b563-535a088a4793 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:52.653316 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386fcfc-b663-43ad-b563-535a088a4793 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:52.654015 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386fcfc-b663-43ad-b563-535a088a4793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:52.655453 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386fcfc-b663-43ad-b563-535a088a4793 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:52.664490 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 478/946] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:41:52.676168 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 468/946] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 13:41:52 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:41:52.689091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5abdd-ee2a-4039-a2dd-809636f488e0 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:52.832034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5abdd-ee2a-4039-a2dd-809636f488e0 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:52.851292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:52.875325 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88068d5f-8b7b-4ebf-856c-1a394efe65b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:52.876717 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88068d5f-8b7b-4ebf-856c-1a394efe65b5 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:52.876936 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88068d5f-8b7b-4ebf-856c-1a394efe65b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:52.877208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88068d5f-8b7b-4ebf-856c-1a394efe65b5 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:52.878063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88068d5f-8b7b-4ebf-856c-1a394efe65b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:52.879588 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88068d5f-8b7b-4ebf-856c-1a394efe65b5 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:52.881104 dv-cinder-803823-8-smb devstack@keystone.service[86644]: WARNING keystone.server.flask.common [None req-88068d5f-8b7b-4ebf-856c-1a394efe65b5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 13:41:52.912079 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.sql.core [None req-88068d5f-8b7b-4ebf-856c-1a394efe65b5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 13:41:52.912079 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 13:41:52.912079 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [parameters: {'id': '862594d9efcb4e3c99cb6f92c2fefe5b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 13:41:52.912079 dv-cinder-803823-8-smb devstack@keystone.service[86644]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86644) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-88068d5f-8b7b-4ebf-856c-1a394efe65b5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 862594d9efcb4e3c99cb6f92c2fefe5b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 862594d9efcb4e3c99cb6f92c2fefe5b. May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application conn.query(q) May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:41:52.935665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application result.read() May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 13:41:52.937557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application next(self.gen) May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application yield resource May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application next(self.gen) May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self.session.rollback() May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self.force_reraise() May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise self.value May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application session.commit() May 25 13:41:52.939674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._prepare_impl() May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self.session.flush() May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._flush(objects) May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application compat.raise_( May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application flush_context.execute() May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 13:41:52.941824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rec.execute(self) May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 13:41:52.944515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application conn.query(q) May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application result.read() May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:41:52.946077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [parameters: {'id': '862594d9efcb4e3c99cb6f92c2fefe5b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:52.950273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:52.951288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:52.952629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:52.952629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 13:41:52.952629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 13:41:52.952629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:52.952629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:52.952629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 13:41:52.952629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 13:41:52.952629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 862594d9efcb4e3c99cb6f92c2fefe5b. May 25 13:41:52.952629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:52.952629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 479/947] 10.222.0.24 () {60 vars in 1140 bytes} [Wed May 25 13:41:52 2022] POST /identity/v3/projects => generated 262 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:52.953318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386fcfc-b663-43ad-b563-535a088a4793 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:53.016794 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:53.069541 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386fcfc-b663-43ad-b563-535a088a4793 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:53.120838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245b1c2-36a4-4388-8fc7-7e7c007f890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:53.121896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245b1c2-36a4-4388-8fc7-7e7c007f890a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:53.122374 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245b1c2-36a4-4388-8fc7-7e7c007f890a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:53.122843 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245b1c2-36a4-4388-8fc7-7e7c007f890a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:53.134422 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245b1c2-36a4-4388-8fc7-7e7c007f890a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:53.137118 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245b1c2-36a4-4388-8fc7-7e7c007f890a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-e245b1c2-36a4-4388-8fc7-7e7c007f890a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:53.154294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:53.155261 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:53.156207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:53.156207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:53.156207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:53.156207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:53.156207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:53.156207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:53.156207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:53.156207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:53.156207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 469/948] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:53.161883 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88068d5f-8b7b-4ebf-856c-1a394efe65b5 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:53.315108 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88068d5f-8b7b-4ebf-856c-1a394efe65b5 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:53.367015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a410258-6cf3-4cc9-9c81-00602b82174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:53.367846 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a410258-6cf3-4cc9-9c81-00602b82174f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:53.368229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a410258-6cf3-4cc9-9c81-00602b82174f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:53.368589 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a410258-6cf3-4cc9-9c81-00602b82174f None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:53.369548 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a410258-6cf3-4cc9-9c81-00602b82174f None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:53.369978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a410258-6cf3-4cc9-9c81-00602b82174f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:53.372291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a410258-6cf3-4cc9-9c81-00602b82174f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:53.399885 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 480/949] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:41:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:54.226821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667949d-ae06-46c6-9ba9-4b0544018564 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:54.227637 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667949d-ae06-46c6-9ba9-4b0544018564 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:54.227637 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667949d-ae06-46c6-9ba9-4b0544018564 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:54.229416 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 470/950] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:54.236062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8276f-b28b-4056-becb-2bedfbc37d96 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:54.236638 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8276f-b28b-4056-becb-2bedfbc37d96 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:54.236940 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8276f-b28b-4056-becb-2bedfbc37d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:54.263409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-bac8276f-b28b-4056-becb-2bedfbc37d96 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:54.265583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-bac8276f-b28b-4056-becb-2bedfbc37d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:54.295408 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:54.369298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 481/951] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:54.392076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667949d-ae06-46c6-9ba9-4b0544018564 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:54.440075 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817144a-2325-4fe7-8221-daf5e691079d None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:54.441007 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817144a-2325-4fe7-8221-daf5e691079d None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:54.441408 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817144a-2325-4fe7-8221-daf5e691079d None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:54.443916 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 482/952] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:54.450882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72df2d-4ca7-4c19-a4da-b2fb8a0f6518 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:54.451299 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72df2d-4ca7-4c19-a4da-b2fb8a0f6518 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:54.451701 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72df2d-4ca7-4c19-a4da-b2fb8a0f6518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:54.474903 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-ea72df2d-4ca7-4c19-a4da-b2fb8a0f6518 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:54.476606 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-ea72df2d-4ca7-4c19-a4da-b2fb8a0f6518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:54.555039 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667949d-ae06-46c6-9ba9-4b0544018564 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:54.574095 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 483/953] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:41:54.575070 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:54.599140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72df2d-4ca7-4c19-a4da-b2fb8a0f6518 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:54.618361 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218d54b-07fe-4b89-82d3-e143c012af69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:54.619222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d54b-07fe-4b89-82d3-e143c012af69 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:54.619964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d54b-07fe-4b89-82d3-e143c012af69 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:54.620347 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d54b-07fe-4b89-82d3-e143c012af69 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:54.621015 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218d54b-07fe-4b89-82d3-e143c012af69 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:54.623031 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218d54b-07fe-4b89-82d3-e143c012af69 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-2218d54b-07fe-4b89-82d3-e143c012af69 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:54.640505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:54.642391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:54.643615 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 471/954] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:54.653866 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218d54b-07fe-4b89-82d3-e143c012af69 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:54.760557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:54.782247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72df2d-4ca7-4c19-a4da-b2fb8a0f6518 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:54.829323 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218d54b-07fe-4b89-82d3-e143c012af69 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:54.835403 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d3a58-1a88-49c3-a930-81f672489c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:54.836446 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d3a58-1a88-49c3-a930-81f672489c16 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:54.836767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d3a58-1a88-49c3-a930-81f672489c16 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:54.837024 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d3a58-1a88-49c3-a930-81f672489c16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:54.851609 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d3a58-1a88-49c3-a930-81f672489c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-811d3a58-1a88-49c3-a930-81f672489c16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:41:54.862462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:54.864184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:54.865698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:54.865698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:54.865698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:54.865698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:54.865698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:41:54.865698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:41:54.865698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:41:54.865698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:41:54.865698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:41:54.865698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:41:54.865698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:41:54.865698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:54.869385 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 484/955] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 13:41:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:54.870395 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d3a58-1a88-49c3-a930-81f672489c16 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:54.900033 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733171e7-b8dc-4a51-bd75-ccebf7aab474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:54.901620 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733171e7-b8dc-4a51-bd75-ccebf7aab474 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:54.902345 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733171e7-b8dc-4a51-bd75-ccebf7aab474 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:54.903248 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733171e7-b8dc-4a51-bd75-ccebf7aab474 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:54.904732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733171e7-b8dc-4a51-bd75-ccebf7aab474 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:54.905532 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733171e7-b8dc-4a51-bd75-ccebf7aab474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:54.908084 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733171e7-b8dc-4a51-bd75-ccebf7aab474 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:54.924057 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 472/956] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:41:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:54.926050 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733171e7-b8dc-4a51-bd75-ccebf7aab474 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:55.003603 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:55.009134 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d3a58-1a88-49c3-a930-81f672489c16 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:55.063202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473539-1014-456c-bf7e-4ae733ea8807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:55.063912 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473539-1014-456c-bf7e-4ae733ea8807 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.064221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473539-1014-456c-bf7e-4ae733ea8807 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.064504 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473539-1014-456c-bf7e-4ae733ea8807 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.065288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff473539-1014-456c-bf7e-4ae733ea8807 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:55.065598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff473539-1014-456c-bf7e-4ae733ea8807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:55.068146 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff473539-1014-456c-bf7e-4ae733ea8807 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:55.080216 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 485/957] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 13:41:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:55.087259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473539-1014-456c-bf7e-4ae733ea8807 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:55.097551 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733171e7-b8dc-4a51-bd75-ccebf7aab474 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:55.102833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:55.144350 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25ed34-6c92-47a2-91f5-7622de45c63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:55.145697 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25ed34-6c92-47a2-91f5-7622de45c63c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.146217 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25ed34-6c92-47a2-91f5-7622de45c63c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.146794 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25ed34-6c92-47a2-91f5-7622de45c63c None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.148414 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25ed34-6c92-47a2-91f5-7622de45c63c None admin] RBAC: Adding query filter params (type=compute) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:55.148997 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25ed34-6c92-47a2-91f5-7622de45c63c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:55.150700 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25ed34-6c92-47a2-91f5-7622de45c63c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:55.160575 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 473/958] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:41:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:55.227641 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2916f-f83c-4f3e-805d-d96927d98970 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.228305 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2916f-f83c-4f3e-805d-d96927d98970 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.228305 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2916f-f83c-4f3e-805d-d96927d98970 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.230350 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473539-1014-456c-bf7e-4ae733ea8807 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:55.234749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 474/959] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:41:55.236527 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321bc0-a0d6-4ed0-b836-202aa97226c3 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.236943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321bc0-a0d6-4ed0-b836-202aa97226c3 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.237349 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321bc0-a0d6-4ed0-b836-202aa97226c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.263671 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-38321bc0-a0d6-4ed0-b836-202aa97226c3 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:55.265340 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-38321bc0-a0d6-4ed0-b836-202aa97226c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:55.275670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407de0d-a57d-4b01-8cea-085f1fa5ac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:55.276524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407de0d-a57d-4b01-8cea-085f1fa5ac3d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.276809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407de0d-a57d-4b01-8cea-085f1fa5ac3d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.277875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407de0d-a57d-4b01-8cea-085f1fa5ac3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.293340 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407de0d-a57d-4b01-8cea-085f1fa5ac3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:55.294851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407de0d-a57d-4b01-8cea-085f1fa5ac3d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-c407de0d-a57d-4b01-8cea-085f1fa5ac3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:55.317722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:55.318700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:55.320163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:55.320163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:55.320163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:55.320163 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:55.321583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 486/960] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:55.326988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407de0d-a57d-4b01-8cea-085f1fa5ac3d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:55.383952 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 475/961] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:55.409581 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:55.412734 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321bc0-a0d6-4ed0-b836-202aa97226c3 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:55.472796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:55.490864 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407de0d-a57d-4b01-8cea-085f1fa5ac3d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:55.547813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321bc0-a0d6-4ed0-b836-202aa97226c3 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:55.555541 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007a455-5e5d-4f34-afec-3343243150b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:55.556918 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007a455-5e5d-4f34-afec-3343243150b7 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.557649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007a455-5e5d-4f34-afec-3343243150b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.558140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007a455-5e5d-4f34-afec-3343243150b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.559501 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007a455-5e5d-4f34-afec-3343243150b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:55.560387 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007a455-5e5d-4f34-afec-3343243150b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:55.562959 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007a455-5e5d-4f34-afec-3343243150b7 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:55.588192 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 487/962] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:55.592516 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f831ca9-54cc-48b5-996a-a36da20351d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:55.593471 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f831ca9-54cc-48b5-996a-a36da20351d3 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.593762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f831ca9-54cc-48b5-996a-a36da20351d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.594052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f831ca9-54cc-48b5-996a-a36da20351d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.594756 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f831ca9-54cc-48b5-996a-a36da20351d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:55.596239 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f831ca9-54cc-48b5-996a-a36da20351d3 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:55.596597 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007a455-5e5d-4f34-afec-3343243150b7 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-9f831ca9-54cc-48b5-996a-a36da20351d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:55.610625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:55.613448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:41:55.615026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:55.617680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 476/963] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 13:41:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:55.618668 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f831ca9-54cc-48b5-996a-a36da20351d3 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:55.723393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:55.727736 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f831ca9-54cc-48b5-996a-a36da20351d3 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:55.764197 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ed4db-94db-4a62-95f2-1d1d021a5275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:55.765056 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed4db-94db-4a62-95f2-1d1d021a5275 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.765449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed4db-94db-4a62-95f2-1d1d021a5275 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.765833 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed4db-94db-4a62-95f2-1d1d021a5275 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.766660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ed4db-94db-4a62-95f2-1d1d021a5275 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:55.767074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ed4db-94db-4a62-95f2-1d1d021a5275 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:55.768635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ed4db-94db-4a62-95f2-1d1d021a5275 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:55.775202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007a455-5e5d-4f34-afec-3343243150b7 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:55.779654 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 477/964] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 13:41:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:55.780627 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ed4db-94db-4a62-95f2-1d1d021a5275 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:55.797339 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:55.820062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fd8ae-6ebe-47fe-925c-af180a3fbf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:55.821466 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fd8ae-6ebe-47fe-925c-af180a3fbf47 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.821753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fd8ae-6ebe-47fe-925c-af180a3fbf47 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.822036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fd8ae-6ebe-47fe-925c-af180a3fbf47 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.831168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fd8ae-6ebe-47fe-925c-af180a3fbf47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:55.832254 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fd8ae-6ebe-47fe-925c-af180a3fbf47 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-fe6fd8ae-6ebe-47fe-925c-af180a3fbf47 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:55.849825 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:55.850942 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:55.851993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:55.851993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:55.851993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:55.851993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:55.851993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:55.851993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:55.851993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:55.851993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:55.851993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:41:55.851993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:55.851993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 488/965] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 13:41:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:55.853138 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939e975-0044-413f-9eb9-b899e4e21d98 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.853138 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939e975-0044-413f-9eb9-b899e4e21d98 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.853138 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939e975-0044-413f-9eb9-b899e4e21d98 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.854219 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 489/966] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:55.857019 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939e975-0044-413f-9eb9-b899e4e21d98 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:55.902079 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ed4db-94db-4a62-95f2-1d1d021a5275 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:55.938100 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502f15b-f05a-4a41-9a3f-8a239094cb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:55.938770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502f15b-f05a-4a41-9a3f-8a239094cb44 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.939055 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502f15b-f05a-4a41-9a3f-8a239094cb44 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.939337 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502f15b-f05a-4a41-9a3f-8a239094cb44 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.940041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502f15b-f05a-4a41-9a3f-8a239094cb44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:55.940373 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502f15b-f05a-4a41-9a3f-8a239094cb44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:55.941758 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502f15b-f05a-4a41-9a3f-8a239094cb44 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:55.947818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 478/967] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 13:41:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:55.953579 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b842ba-75df-4d26-af7e-bdd303b9b915 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.953872 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b842ba-75df-4d26-af7e-bdd303b9b915 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.954343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b842ba-75df-4d26-af7e-bdd303b9b915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.971639 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-57b842ba-75df-4d26-af7e-bdd303b9b915 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:55.973020 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-57b842ba-75df-4d26-af7e-bdd303b9b915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:55.975128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939e975-0044-413f-9eb9-b899e4e21d98 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:55.999723 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:56.014126 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ec72a-d5e9-4c39-8b29-826a11f7533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:56.014809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ec72a-d5e9-4c39-8b29-826a11f7533e None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:56.015097 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ec72a-d5e9-4c39-8b29-826a11f7533e None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:56.015376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ec72a-d5e9-4c39-8b29-826a11f7533e None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:56.016261 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ec72a-d5e9-4c39-8b29-826a11f7533e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:56.016578 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ec72a-d5e9-4c39-8b29-826a11f7533e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:56.018047 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ec72a-d5e9-4c39-8b29-826a11f7533e None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:56.036805 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 490/968] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 13:41:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:56.037611 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ec72a-d5e9-4c39-8b29-826a11f7533e None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:56.054846 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 479/969] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:56.055777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b842ba-75df-4d26-af7e-bdd303b9b915 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:56.085425 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:56.157148 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ec72a-d5e9-4c39-8b29-826a11f7533e None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:56.176976 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b842ba-75df-4d26-af7e-bdd303b9b915 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:56.193016 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8955838-ed75-4436-81dd-d53ce06c4039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:56.193553 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8955838-ed75-4436-81dd-d53ce06c4039 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:56.193840 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8955838-ed75-4436-81dd-d53ce06c4039 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:56.194206 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8955838-ed75-4436-81dd-d53ce06c4039 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:56.195214 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8955838-ed75-4436-81dd-d53ce06c4039 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:56.196866 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8955838-ed75-4436-81dd-d53ce06c4039 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:56.216287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533e529-01e8-4db9-98de-b2027c62ecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:56.216946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533e529-01e8-4db9-98de-b2027c62ecf5 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:56.217232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533e529-01e8-4db9-98de-b2027c62ecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:56.217582 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 491/970] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 13:41:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:41:56.218405 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8955838-ed75-4436-81dd-d53ce06c4039 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:56.228695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533e529-01e8-4db9-98de-b2027c62ecf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:56.266690 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:56.320497 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533e529-01e8-4db9-98de-b2027c62ecf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:56.322661 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533e529-01e8-4db9-98de-b2027c62ecf5 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:56.332505 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:56.352418 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8955838-ed75-4436-81dd-d53ce06c4039 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:56.395716 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d22813-7dc6-4532-90a2-a0bd238ed62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:56.396572 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d22813-7dc6-4532-90a2-a0bd238ed62d None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:56.396998 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d22813-7dc6-4532-90a2-a0bd238ed62d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:56.397355 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d22813-7dc6-4532-90a2-a0bd238ed62d None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:56.399069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d22813-7dc6-4532-90a2-a0bd238ed62d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:56.400727 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d22813-7dc6-4532-90a2-a0bd238ed62d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:56.418661 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.sql.core [None req-a6d22813-7dc6-4532-90a2-a0bd238ed62d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 13:41:56.418661 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 13:41:56.418661 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [parameters: {'user_id': '7828f900d73d42ceb92d4ac370f7f492', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 13:41:56.418661 dv-cinder-803823-8-smb devstack@keystone.service[86644]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86644) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-a6d22813-7dc6-4532-90a2-a0bd238ed62d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application conn.query(q) May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application result.read() May 25 13:41:56.428083 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:41:56.429508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application next(self.gen) May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application yield resource May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application next(self.gen) May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self.session.rollback() May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self.force_reraise() May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise self.value May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application session.commit() May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 13:41:56.430886 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._prepare_impl() May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self.session.flush() May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._flush(objects) May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application compat.raise_( May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application flush_context.execute() May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rec.execute(self) May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 13:41:56.432174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:41:56.433194 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application conn.query(q) May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application result.read() May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:41:56.435832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [parameters: {'user_id': '7828f900d73d42ceb92d4ac370f7f492', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:56.437794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 13:41:56.438670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 13:41:56.439986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 13:41:56.439986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 13:41:56.439986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 13:41:56.439986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 13:41:56.439986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 13:41:56.439986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:56.439986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 492/971] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 13:41:56 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:56.443419 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d22813-7dc6-4532-90a2-a0bd238ed62d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:56.475298 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 480/972] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:41:56 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:41:56.483141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533e529-01e8-4db9-98de-b2027c62ecf5 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:56.556956 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:56.567395 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d22813-7dc6-4532-90a2-a0bd238ed62d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:56.604631 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2cb9b-8c4b-415a-88be-3ff4537e610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:56.605625 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2cb9b-8c4b-415a-88be-3ff4537e610e None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:56.606012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2cb9b-8c4b-415a-88be-3ff4537e610e None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:56.606220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533e529-01e8-4db9-98de-b2027c62ecf5 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:56.606480 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2cb9b-8c4b-415a-88be-3ff4537e610e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:56.615456 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2cb9b-8c4b-415a-88be-3ff4537e610e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:56.617509 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2cb9b-8c4b-415a-88be-3ff4537e610e None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-01b2cb9b-8c4b-415a-88be-3ff4537e610e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:41:56.634073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:56.635198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:56.636860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:56.636860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:56.636860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:41:56.636860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:41:56.636860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:41:56.636860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:41:56.636860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:41:56.636860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:41:56.636860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:41:56.636860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:56.636860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 493/973] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:41:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:56.642565 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2cb9b-8c4b-415a-88be-3ff4537e610e None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:56.656661 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:56.658862 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b777ca6-9ae2-4af4-9616-8a14f3e93d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:56.660233 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b777ca6-9ae2-4af4-9616-8a14f3e93d64 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:56.660741 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b777ca6-9ae2-4af4-9616-8a14f3e93d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:56.661399 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b777ca6-9ae2-4af4-9616-8a14f3e93d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:56.673365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b777ca6-9ae2-4af4-9616-8a14f3e93d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:56.675260 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b777ca6-9ae2-4af4-9616-8a14f3e93d64 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-4b777ca6-9ae2-4af4-9616-8a14f3e93d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:41:56.695214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:56.696240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:56.697149 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:41:56.697149 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:41:56.697149 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:41:56.697149 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:41:56.703845 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 481/974] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:41:56.706236 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b777ca6-9ae2-4af4-9616-8a14f3e93d64 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:56.755601 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2cb9b-8c4b-415a-88be-3ff4537e610e None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:56.800292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8820158-0127-451b-95db-497b221be500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:56.800974 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8820158-0127-451b-95db-497b221be500 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:56.801261 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8820158-0127-451b-95db-497b221be500 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:56.801538 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8820158-0127-451b-95db-497b221be500 None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:56.802358 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8820158-0127-451b-95db-497b221be500 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:56.802667 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8820158-0127-451b-95db-497b221be500 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:56.804831 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8820158-0127-451b-95db-497b221be500 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:56.837853 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b777ca6-9ae2-4af4-9616-8a14f3e93d64 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:56.846991 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 494/975] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 13:41:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:56.876093 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:56.881471 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cedcc6-edb2-423e-99b1-b8ae22bef56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:56.882574 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cedcc6-edb2-423e-99b1-b8ae22bef56e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:56.882882 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cedcc6-edb2-423e-99b1-b8ae22bef56e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:56.883166 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cedcc6-edb2-423e-99b1-b8ae22bef56e None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:56.883918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cedcc6-edb2-423e-99b1-b8ae22bef56e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:56.884262 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cedcc6-edb2-423e-99b1-b8ae22bef56e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:56.885690 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cedcc6-edb2-423e-99b1-b8ae22bef56e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:56.900756 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 482/976] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:41:56.906518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8820158-0127-451b-95db-497b221be500 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:56.989829 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:57.030899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8820158-0127-451b-95db-497b221be500 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:57.071211 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6f27-fa93-4689-a7ce-f922a9c2cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:57.072032 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6f27-fa93-4689-a7ce-f922a9c2cc4b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:57.072346 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6f27-fa93-4689-a7ce-f922a9c2cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:57.072623 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6f27-fa93-4689-a7ce-f922a9c2cc4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:57.080088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c6f27-fa93-4689-a7ce-f922a9c2cc4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:57.081598 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c6f27-fa93-4689-a7ce-f922a9c2cc4b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-405c6f27-fa93-4689-a7ce-f922a9c2cc4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:41:57.096765 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:57.097726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:57.099061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:41:57.099061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:41:57.099061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:41:57.099061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:41:57.099061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:41:57.099061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:41:57.099061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:41:57.099061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:57.099061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 495/977] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:57.106817 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cedcc6-edb2-423e-99b1-b8ae22bef56e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:57.248065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cedcc6-edb2-423e-99b1-b8ae22bef56e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:57.287007 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f05fbe-6753-429b-8acc-f9a5ac03c7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:57.287576 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f05fbe-6753-429b-8acc-f9a5ac03c7fa None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:57.287925 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f05fbe-6753-429b-8acc-f9a5ac03c7fa None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:57.288805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f05fbe-6753-429b-8acc-f9a5ac03c7fa None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:57.289631 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f05fbe-6753-429b-8acc-f9a5ac03c7fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:57.289944 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f05fbe-6753-429b-8acc-f9a5ac03c7fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:57.291385 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f05fbe-6753-429b-8acc-f9a5ac03c7fa None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:57.309148 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 483/978] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:57.310830 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6f27-fa93-4689-a7ce-f922a9c2cc4b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:57.435785 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6f27-fa93-4689-a7ce-f922a9c2cc4b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:57.478327 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:57.491208 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db980224-78d7-4dfa-b308-3ea3d4422738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:57.492692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980224-78d7-4dfa-b308-3ea3d4422738 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:57.492824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980224-78d7-4dfa-b308-3ea3d4422738 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:57.493101 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980224-78d7-4dfa-b308-3ea3d4422738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:57.494086 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db980224-78d7-4dfa-b308-3ea3d4422738 None admin] RBAC: Adding query filter params (role.id=53a0e5251cb44b8aa29d218cd5a19860, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=b1e5039385f44bb2b52e795524d6b8d2) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:57.494404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db980224-78d7-4dfa-b308-3ea3d4422738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:57.495939 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db980224-78d7-4dfa-b308-3ea3d4422738 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:57.502623 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 496/979] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:41:57 2022] GET /identity/v3/role_assignments?user.id=b1e5039385f44bb2b52e795524d6b8d2&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=53a0e5251cb44b8aa29d218cd5a19860 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:57.570179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbf5f5-cd10-4c59-9018-b0e5eddb3bda None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:57.570458 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbf5f5-cd10-4c59-9018-b0e5eddb3bda None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:57.570792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbf5f5-cd10-4c59-9018-b0e5eddb3bda None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:57.572529 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 484/980] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:57.578373 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be5d48-1dcc-4d4f-b30f-539642db9898 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:57.578688 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be5d48-1dcc-4d4f-b30f-539642db9898 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:57.578939 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be5d48-1dcc-4d4f-b30f-539642db9898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:57.598236 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-f2be5d48-1dcc-4d4f-b30f-539642db9898 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:57.600088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-f2be5d48-1dcc-4d4f-b30f-539642db9898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:57.684306 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 497/981] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:57.707278 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbf5f5-cd10-4c59-9018-b0e5eddb3bda None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:57.752157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:57.831385 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbf5f5-cd10-4c59-9018-b0e5eddb3bda None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:57.869203 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d607f-beb0-495a-8609-284a00e891f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:57.869929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d607f-beb0-495a-8609-284a00e891f3 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:57.870213 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d607f-beb0-495a-8609-284a00e891f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:57.870489 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d607f-beb0-495a-8609-284a00e891f3 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:57.871223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d607f-beb0-495a-8609-284a00e891f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:57.872617 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d607f-beb0-495a-8609-284a00e891f3 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:57.892150 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 485/982] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:41:57 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:41:58.695854 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d7c5d-3d8f-487e-91d9-dfe437f505c5 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:58.696698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d7c5d-3d8f-487e-91d9-dfe437f505c5 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:58.696698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d7c5d-3d8f-487e-91d9-dfe437f505c5 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:58.698092 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 498/983] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:58.704041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0864a-24a9-4698-9bef-3e1f0fec9785 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:58.704604 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0864a-24a9-4698-9bef-3e1f0fec9785 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:58.704732 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0864a-24a9-4698-9bef-3e1f0fec9785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:58.727445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-5fe0864a-24a9-4698-9bef-3e1f0fec9785 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:58.728736 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-5fe0864a-24a9-4698-9bef-3e1f0fec9785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:58.812582 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 486/984] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:58.835902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d7c5d-3d8f-487e-91d9-dfe437f505c5 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:58.966969 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d7c5d-3d8f-487e-91d9-dfe437f505c5 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:58.994607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:59.008805 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eda914-96a6-43e6-8c84-47794eca4ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:59.009639 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eda914-96a6-43e6-8c84-47794eca4ac8 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:59.009923 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eda914-96a6-43e6-8c84-47794eca4ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:59.010197 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eda914-96a6-43e6-8c84-47794eca4ac8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:59.010868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eda914-96a6-43e6-8c84-47794eca4ac8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:59.012334 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eda914-96a6-43e6-8c84-47794eca4ac8 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-55eda914-96a6-43e6-8c84-47794eca4ac8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:41:59.027063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:41:59.031015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:41:59.031992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:41:59.034059 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 499/985] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 13:41:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:41:59.034222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0864a-24a9-4698-9bef-3e1f0fec9785 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:59.053168 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:59.145689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0864a-24a9-4698-9bef-3e1f0fec9785 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:59.182441 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742ad39-558a-4fa9-b9a4-f36bffc399f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:59.183108 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ad39-558a-4fa9-b9a4-f36bffc399f5 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:59.183394 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ad39-558a-4fa9-b9a4-f36bffc399f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:59.183663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ad39-558a-4fa9-b9a4-f36bffc399f5 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:59.184401 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742ad39-558a-4fa9-b9a4-f36bffc399f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:59.184709 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742ad39-558a-4fa9-b9a4-f36bffc399f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:59.186066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742ad39-558a-4fa9-b9a4-f36bffc399f5 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:59.196435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 487/986] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 13:41:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:59.198052 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eda914-96a6-43e6-8c84-47794eca4ac8 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:59.317913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eda914-96a6-43e6-8c84-47794eca4ac8 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:59.353591 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fac5fb-5997-4af0-8514-71c31535c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:59.354271 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac5fb-5997-4af0-8514-71c31535c286 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:59.354564 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac5fb-5997-4af0-8514-71c31535c286 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:59.354843 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac5fb-5997-4af0-8514-71c31535c286 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:59.355563 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fac5fb-5997-4af0-8514-71c31535c286 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:59.355876 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fac5fb-5997-4af0-8514-71c31535c286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:59.357311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fac5fb-5997-4af0-8514-71c31535c286 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:59.362753 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 500/987] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 13:41:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:59.369130 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742ad39-558a-4fa9-b9a4-f36bffc399f5 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:59.458827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:59.480277 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742ad39-558a-4fa9-b9a4-f36bffc399f5 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:59.517525 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890a09d-6410-4672-b829-c27e4036848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:59.518328 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890a09d-6410-4672-b829-c27e4036848b None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:59.518617 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890a09d-6410-4672-b829-c27e4036848b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:59.518896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890a09d-6410-4672-b829-c27e4036848b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:59.519714 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890a09d-6410-4672-b829-c27e4036848b None admin] RBAC: Adding query filter params (interface=admin, service_id=56c58f9f68bb4d0e967abc670f2a3954, region_id=RegionOne) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:41:59.520033 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890a09d-6410-4672-b829-c27e4036848b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:59.521438 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890a09d-6410-4672-b829-c27e4036848b None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:59.527256 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 488/988] 10.222.0.24 () {56 vars in 1249 bytes} [Wed May 25 13:41:59 2022] GET /identity/v3/endpoints?service_id=56c58f9f68bb4d0e967abc670f2a3954&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:41:59.532797 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fac5fb-5997-4af0-8514-71c31535c286 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:59.589348 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:59.649261 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fac5fb-5997-4af0-8514-71c31535c286 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:59.685346 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729e0ce-6e2d-497b-b6cb-76340e015548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:59.686022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729e0ce-6e2d-497b-b6cb-76340e015548 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:59.686307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729e0ce-6e2d-497b-b6cb-76340e015548 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:59.686585 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729e0ce-6e2d-497b-b6cb-76340e015548 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:59.687276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729e0ce-6e2d-497b-b6cb-76340e015548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:59.688701 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729e0ce-6e2d-497b-b6cb-76340e015548 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:59.696148 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 501/989] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 13:41:59 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:41:59.827237 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb4848-e80a-4e83-a8b2-561f6d75f2f9 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:59.827796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb4848-e80a-4e83-a8b2-561f6d75f2f9 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:59.827796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb4848-e80a-4e83-a8b2-561f6d75f2f9 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:59.829362 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 489/990] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:59.835510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923706-36f7-4c38-84a7-d51dd82406b2 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:59.835824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923706-36f7-4c38-84a7-d51dd82406b2 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:59.836077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923706-36f7-4c38-84a7-d51dd82406b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:59.855061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-1d923706-36f7-4c38-84a7-d51dd82406b2 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:59.856255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-1d923706-36f7-4c38-84a7-d51dd82406b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:59.932474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 502/991] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:41:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:41:59.955856 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb4848-e80a-4e83-a8b2-561f6d75f2f9 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:00.068817 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb4848-e80a-4e83-a8b2-561f6d75f2f9 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:00.105298 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e77617-3c81-4761-9335-d2169980b0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:00.106017 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e77617-3c81-4761-9335-d2169980b0b5 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:00.106303 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e77617-3c81-4761-9335-d2169980b0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:00.106580 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e77617-3c81-4761-9335-d2169980b0b5 None admin] PATH_INFO: `/v3/services/image` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:00.107240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e77617-3c81-4761-9335-d2169980b0b5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:00.108759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e77617-3c81-4761-9335-d2169980b0b5 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-31e77617-3c81-4761-9335-d2169980b0b5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:00.121301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:00.122370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:00.128200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 490/992] 10.222.0.24 () {56 vars in 1105 bytes} [Wed May 25 13:41:59 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:00.130778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923706-36f7-4c38-84a7-d51dd82406b2 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:00.154642 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011be7a2-f2d3-4418-a03b-8c8389b9c2a5 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:00.154974 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011be7a2-f2d3-4418-a03b-8c8389b9c2a5 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:00.155293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011be7a2-f2d3-4418-a03b-8c8389b9c2a5 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:00.156719 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 491/993] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:42:00.161428 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074714-dbde-46f9-8365-529c2716c241 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:00.161713 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074714-dbde-46f9-8365-529c2716c241 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:00.161990 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074714-dbde-46f9-8365-529c2716c241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:00.179060 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-26074714-dbde-46f9-8365-529c2716c241 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:00.180439 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-26074714-dbde-46f9-8365-529c2716c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:00.182789 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:00.182988 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:00.242640 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923706-36f7-4c38-84a7-d51dd82406b2 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:00.259351 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 492/994] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:42:00.277877 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0536f68-a361-4c19-a80c-314db746d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:00.278546 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0536f68-a361-4c19-a80c-314db746d458 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:00.278827 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0536f68-a361-4c19-a80c-314db746d458 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:00.279100 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0536f68-a361-4c19-a80c-314db746d458 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:00.279801 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0536f68-a361-4c19-a80c-314db746d458 None admin] RBAC: Adding query filter params (name=image) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:00.280104 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0536f68-a361-4c19-a80c-314db746d458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:00.281563 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0536f68-a361-4c19-a80c-314db746d458 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:00.282169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26074714-dbde-46f9-8365-529c2716c241 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:00.286724 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 503/995] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:00.293189 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0536f68-a361-4c19-a80c-314db746d458 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:00.393335 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26074714-dbde-46f9-8365-529c2716c241 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:00.403663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0536f68-a361-4c19-a80c-314db746d458 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:00.416474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:00.434293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c5de0-f4bd-425e-b9b1-c1d3147278cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:00.435100 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c5de0-f4bd-425e-b9b1-c1d3147278cf None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:00.435386 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c5de0-f4bd-425e-b9b1-c1d3147278cf None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:00.435668 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c5de0-f4bd-425e-b9b1-c1d3147278cf None admin] PATH_INFO: `/v3/services/compute` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:00.436467 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c5de0-f4bd-425e-b9b1-c1d3147278cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:00.437968 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c5de0-f4bd-425e-b9b1-c1d3147278cf None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:00.444647 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f96f8e-dbf8-4d0b-9d5f-a1a9c184c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:00.445321 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f96f8e-dbf8-4d0b-9d5f-a1a9c184c85f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:00.445605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f96f8e-dbf8-4d0b-9d5f-a1a9c184c85f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:00.445884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f96f8e-dbf8-4d0b-9d5f-a1a9c184c85f None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:00.446601 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f96f8e-dbf8-4d0b-9d5f-a1a9c184c85f None admin] RBAC: Adding query filter params (type=image) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:00.446912 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f96f8e-dbf8-4d0b-9d5f-a1a9c184c85f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:00.448312 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f96f8e-dbf8-4d0b-9d5f-a1a9c184c85f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-4a4c5de0-f4bd-425e-b9b1-c1d3147278cf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:00.450612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:00.451830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:42:00.452920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:00.456440 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 504/996] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:00.456852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 493/997] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:42:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:42:00.465566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f96f8e-dbf8-4d0b-9d5f-a1a9c184c85f None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:00.582421 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f96f8e-dbf8-4d0b-9d5f-a1a9c184c85f None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:00.631040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca526ba-f521-463d-af33-509e837683f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:00.631934 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca526ba-f521-463d-af33-509e837683f1 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:00.632451 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca526ba-f521-463d-af33-509e837683f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:00.632943 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca526ba-f521-463d-af33-509e837683f1 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:00.633695 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca526ba-f521-463d-af33-509e837683f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:00.634014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca526ba-f521-463d-af33-509e837683f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:00.635476 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca526ba-f521-463d-af33-509e837683f1 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:00.646040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 505/998] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:42:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:00.648411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c5de0-f4bd-425e-b9b1-c1d3147278cf None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:00.651500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:00.766671 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c5de0-f4bd-425e-b9b1-c1d3147278cf None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:00.806019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030834a-7055-4367-b414-47fc138b8342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:00.806695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030834a-7055-4367-b414-47fc138b8342 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:00.806979 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030834a-7055-4367-b414-47fc138b8342 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:00.807254 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030834a-7055-4367-b414-47fc138b8342 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:00.807969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030834a-7055-4367-b414-47fc138b8342 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:00.808309 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030834a-7055-4367-b414-47fc138b8342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:00.809679 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030834a-7055-4367-b414-47fc138b8342 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:00.820680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 494/999] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:42:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:00.822444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca526ba-f521-463d-af33-509e837683f1 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:00.863162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:00.952441 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca526ba-f521-463d-af33-509e837683f1 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:00.992233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3981b7-29d3-4f6f-bbae-6c5bef457e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:00.992910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3981b7-29d3-4f6f-bbae-6c5bef457e8d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:00.993211 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3981b7-29d3-4f6f-bbae-6c5bef457e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:00.993480 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3981b7-29d3-4f6f-bbae-6c5bef457e8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:00.994289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3981b7-29d3-4f6f-bbae-6c5bef457e8d None admin] RBAC: Adding query filter params (interface=public, service_id=95ee3f18755b4344bdffe9781d291347, region_id=RegionOne) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:00.994607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3981b7-29d3-4f6f-bbae-6c5bef457e8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:00.996019 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3981b7-29d3-4f6f-bbae-6c5bef457e8d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:01.006310 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 506/1000] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 13:42:00 2022] GET /identity/v3/endpoints?service_id=95ee3f18755b4344bdffe9781d291347&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:01.007556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030834a-7055-4367-b414-47fc138b8342 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:01.080222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:01.118332 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030834a-7055-4367-b414-47fc138b8342 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:01.160309 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36abcb-4eda-4e24-b382-9a8810075a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:01.160983 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36abcb-4eda-4e24-b382-9a8810075a79 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:01.161267 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36abcb-4eda-4e24-b382-9a8810075a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:01.161544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36abcb-4eda-4e24-b382-9a8810075a79 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:01.162240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36abcb-4eda-4e24-b382-9a8810075a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:01.163674 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36abcb-4eda-4e24-b382-9a8810075a79 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:01.171101 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 495/1001] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 13:42:01 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:42:02.114519 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25784807-370c-47ae-9c0a-c5352ea9af91 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:02.115292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25784807-370c-47ae-9c0a-c5352ea9af91 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:02.115292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25784807-370c-47ae-9c0a-c5352ea9af91 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:02.117147 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 507/1002] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:02.122387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6d76f-1f21-4563-8e6b-141777a023c2 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:02.123132 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6d76f-1f21-4563-8e6b-141777a023c2 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:02.123132 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6d76f-1f21-4563-8e6b-141777a023c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:02.141913 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-b9f6d76f-1f21-4563-8e6b-141777a023c2 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:02.143132 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-b9f6d76f-1f21-4563-8e6b-141777a023c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:02.218143 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 496/1003] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:02.246897 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25784807-370c-47ae-9c0a-c5352ea9af91 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:02.367066 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:02.372574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25784807-370c-47ae-9c0a-c5352ea9af91 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:02.410091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5080f88-17ce-42f7-afb6-b2c91eb05624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:02.410938 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5080f88-17ce-42f7-afb6-b2c91eb05624 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:02.411218 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5080f88-17ce-42f7-afb6-b2c91eb05624 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:02.411485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5080f88-17ce-42f7-afb6-b2c91eb05624 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:02.412165 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5080f88-17ce-42f7-afb6-b2c91eb05624 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:02.414218 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5080f88-17ce-42f7-afb6-b2c91eb05624 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-c5080f88-17ce-42f7-afb6-b2c91eb05624 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:02.426963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:02.428033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:02.428935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 508/1004] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 13:42:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:02.434755 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6d76f-1f21-4563-8e6b-141777a023c2 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:02.501395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:02.545900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6d76f-1f21-4563-8e6b-141777a023c2 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:02.580962 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d823e6-a53a-4ce7-818a-fe8d980709e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:02.581625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d823e6-a53a-4ce7-818a-fe8d980709e9 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:02.581904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d823e6-a53a-4ce7-818a-fe8d980709e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:02.582204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d823e6-a53a-4ce7-818a-fe8d980709e9 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:02.582886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d823e6-a53a-4ce7-818a-fe8d980709e9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:02.583186 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d823e6-a53a-4ce7-818a-fe8d980709e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:02.585210 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d823e6-a53a-4ce7-818a-fe8d980709e9 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:02.595770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 497/1005] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 13:42:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:02.596787 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5080f88-17ce-42f7-afb6-b2c91eb05624 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:02.720524 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5080f88-17ce-42f7-afb6-b2c91eb05624 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:02.759954 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03477-2ef8-475f-9ec2-d6298caaf20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:02.760678 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03477-2ef8-475f-9ec2-d6298caaf20d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:02.760957 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03477-2ef8-475f-9ec2-d6298caaf20d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:02.761233 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03477-2ef8-475f-9ec2-d6298caaf20d None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:02.761955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d03477-2ef8-475f-9ec2-d6298caaf20d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:02.762260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d03477-2ef8-475f-9ec2-d6298caaf20d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:02.763666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d03477-2ef8-475f-9ec2-d6298caaf20d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:02.775408 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 509/1006] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 13:42:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:02.777379 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d823e6-a53a-4ce7-818a-fe8d980709e9 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:02.905992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944389c6-a893-42ca-bae0-caa07f40d664 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:02.906300 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944389c6-a893-42ca-bae0-caa07f40d664 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:02.906580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944389c6-a893-42ca-bae0-caa07f40d664 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:02.908156 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 510/1007] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:42:02.908716 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d823e6-a53a-4ce7-818a-fe8d980709e9 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:02.913397 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d96961-d694-4ec9-a937-decb28791a03 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:02.913884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d96961-d694-4ec9-a937-decb28791a03 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:02.914170 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d96961-d694-4ec9-a937-decb28791a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:02.932312 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-44d96961-d694-4ec9-a937-decb28791a03 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:02.933527 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-44d96961-d694-4ec9-a937-decb28791a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:02.935265 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:02.950391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b09ff-7887-4523-900e-eb0304cd840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:02.951060 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b09ff-7887-4523-900e-eb0304cd840d None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:02.951337 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b09ff-7887-4523-900e-eb0304cd840d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:02.951610 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b09ff-7887-4523-900e-eb0304cd840d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:02.952420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b09ff-7887-4523-900e-eb0304cd840d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:02.953794 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b09ff-7887-4523-900e-eb0304cd840d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:02.960569 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:02.972978 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 498/1008] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 13:42:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:42:03.036565 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 511/1009] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:42:03.057365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b09ff-7887-4523-900e-eb0304cd840d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:03.179231 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b09ff-7887-4523-900e-eb0304cd840d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:03.218326 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f001a9-8060-4487-b8be-8cb04c08d3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:03.218915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f001a9-8060-4487-b8be-8cb04c08d3f7 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:03.219198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f001a9-8060-4487-b8be-8cb04c08d3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:03.219474 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f001a9-8060-4487-b8be-8cb04c08d3f7 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:03.220241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f001a9-8060-4487-b8be-8cb04c08d3f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:03.221616 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f001a9-8060-4487-b8be-8cb04c08d3f7 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:03.236689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 499/1010] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:42:03 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:42:03.488936 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e182f5-e46c-45a8-b2f6-0ce6f0c4c7a6 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:03.489526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e182f5-e46c-45a8-b2f6-0ce6f0c4c7a6 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:03.489526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e182f5-e46c-45a8-b2f6-0ce6f0c4c7a6 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:03.491477 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 512/1011] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:03.497617 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5bae5-5c3c-4a45-9cf0-e73732562192 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:03.497900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5bae5-5c3c-4a45-9cf0-e73732562192 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:03.498180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5bae5-5c3c-4a45-9cf0-e73732562192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:03.515636 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-28e5bae5-5c3c-4a45-9cf0-e73732562192 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:03.516892 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-28e5bae5-5c3c-4a45-9cf0-e73732562192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:03.562784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:03.601649 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 500/1012] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:03 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:03.624622 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e182f5-e46c-45a8-b2f6-0ce6f0c4c7a6 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:03.754770 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e182f5-e46c-45a8-b2f6-0ce6f0c4c7a6 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:03.794290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a163b8-ca4e-48ab-874c-e468827547a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:03.795111 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a163b8-ca4e-48ab-874c-e468827547a1 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:03.795392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a163b8-ca4e-48ab-874c-e468827547a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:03.797341 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a163b8-ca4e-48ab-874c-e468827547a1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:03.797341 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a163b8-ca4e-48ab-874c-e468827547a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:03.797775 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a163b8-ca4e-48ab-874c-e468827547a1 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-76a163b8-ca4e-48ab-874c-e468827547a1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:03.810809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:03.811929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:03.818245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 513/1013] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:42:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:03.819279 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5bae5-5c3c-4a45-9cf0-e73732562192 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:03.925640 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5bae5-5c3c-4a45-9cf0-e73732562192 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:03.964983 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3f682-eb1b-410f-86d2-babe20af941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:03.965657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3f682-eb1b-410f-86d2-babe20af941e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:03.965943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3f682-eb1b-410f-86d2-babe20af941e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:03.966222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3f682-eb1b-410f-86d2-babe20af941e None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:03.966943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3f682-eb1b-410f-86d2-babe20af941e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:03.967249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3f682-eb1b-410f-86d2-babe20af941e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:03.968671 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3f682-eb1b-410f-86d2-babe20af941e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:03.980150 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 501/1014] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:42:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:03.981154 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a163b8-ca4e-48ab-874c-e468827547a1 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:04.009212 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:04.099502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a163b8-ca4e-48ab-874c-e468827547a1 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:04.135563 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5fab9-3b40-4d3e-b50b-399469df438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:04.136258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5fab9-3b40-4d3e-b50b-399469df438a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:04.136545 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5fab9-3b40-4d3e-b50b-399469df438a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:04.136823 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5fab9-3b40-4d3e-b50b-399469df438a None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:04.137534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5fab9-3b40-4d3e-b50b-399469df438a None admin] RBAC: Adding query filter params (type=compute) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:04.137844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5fab9-3b40-4d3e-b50b-399469df438a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:04.139238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5fab9-3b40-4d3e-b50b-399469df438a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:04.148344 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 514/1015] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 13:42:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:04.150734 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3f682-eb1b-410f-86d2-babe20af941e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:04.186157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:04.256164 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3f682-eb1b-410f-86d2-babe20af941e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:04.292186 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e3202-33a4-4c29-86f2-f78e8342c438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:04.292760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e3202-33a4-4c29-86f2-f78e8342c438 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:04.293042 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e3202-33a4-4c29-86f2-f78e8342c438 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:04.293314 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e3202-33a4-4c29-86f2-f78e8342c438 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:04.294072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e3202-33a4-4c29-86f2-f78e8342c438 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:04.295430 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e3202-33a4-4c29-86f2-f78e8342c438 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:04.315638 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 502/1016] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 13:42:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:42:05.369986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b232d05-2eb0-40df-9d48-6289f0faa5b4 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:05.370600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b232d05-2eb0-40df-9d48-6289f0faa5b4 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:05.370600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b232d05-2eb0-40df-9d48-6289f0faa5b4 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:05.371959 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 515/1017] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:05.377914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b090b6-8642-4d4f-9313-ee3fb18fb75c None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:05.378489 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b090b6-8642-4d4f-9313-ee3fb18fb75c None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:05.378489 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b090b6-8642-4d4f-9313-ee3fb18fb75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:05.401109 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-45b090b6-8642-4d4f-9313-ee3fb18fb75c None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:05.402362 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-45b090b6-8642-4d4f-9313-ee3fb18fb75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:05.479669 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 503/1018] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:05.503515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b232d05-2eb0-40df-9d48-6289f0faa5b4 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:05.582357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b065a4-ae0e-48e4-b9e5-fbca85d96c40 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:05.582664 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b065a4-ae0e-48e4-b9e5-fbca85d96c40 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:05.583090 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b065a4-ae0e-48e4-b9e5-fbca85d96c40 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:05.584731 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 504/1019] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:42:05.589751 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539fe42-b0e4-4ece-8e5c-a762b75829b4 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:05.590041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539fe42-b0e4-4ece-8e5c-a762b75829b4 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:05.590322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539fe42-b0e4-4ece-8e5c-a762b75829b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:05.593152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:05.609534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-0539fe42-b0e4-4ece-8e5c-a762b75829b4 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:05.610792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-0539fe42-b0e4-4ece-8e5c-a762b75829b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:05.614914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b232d05-2eb0-40df-9d48-6289f0faa5b4 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:05.623246 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:05.655435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9bf54-aaee-4e45-b6ce-255019d99e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:05.656281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9bf54-aaee-4e45-b6ce-255019d99e58 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:05.656566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9bf54-aaee-4e45-b6ce-255019d99e58 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:05.656935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9bf54-aaee-4e45-b6ce-255019d99e58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:05.658166 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9bf54-aaee-4e45-b6ce-255019d99e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:05.659643 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9bf54-aaee-4e45-b6ce-255019d99e58 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:05.661490 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 516/1020] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:05.667625 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9bf54-aaee-4e45-b6ce-255019d99e58 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:05.686650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 505/1021] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:42:05.709884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539fe42-b0e4-4ece-8e5c-a762b75829b4 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:05.779760 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9bf54-aaee-4e45-b6ce-255019d99e58 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:05.816967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539fe42-b0e4-4ece-8e5c-a762b75829b4 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:05.817990 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf77dc-a29c-4263-8221-7b20ff85044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:05.819201 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf77dc-a29c-4263-8221-7b20ff85044c None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:05.819665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf77dc-a29c-4263-8221-7b20ff85044c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:05.819987 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf77dc-a29c-4263-8221-7b20ff85044c None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:05.820748 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf77dc-a29c-4263-8221-7b20ff85044c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:05.822212 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf77dc-a29c-4263-8221-7b20ff85044c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:05.853983 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 517/1022] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:42:05 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:42:05.865062 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1bf0-b075-4564-8396-1b6d87dd4e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:05.866210 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1bf0-b075-4564-8396-1b6d87dd4e9c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:05.866618 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1bf0-b075-4564-8396-1b6d87dd4e9c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:05.866901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1bf0-b075-4564-8396-1b6d87dd4e9c None admin] PATH_INFO: `/v3/services/image` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:05.867728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b1bf0-b075-4564-8396-1b6d87dd4e9c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:05.869391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b1bf0-b075-4564-8396-1b6d87dd4e9c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-cf3b1bf0-b075-4564-8396-1b6d87dd4e9c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:05.884648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:05.885696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:42:05.886556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:05.888306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 506/1023] 10.222.0.24 () {56 vars in 1105 bytes} [Wed May 25 13:42:05 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:05.893288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf77dc-a29c-4263-8221-7b20ff85044c None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:05.896562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:06.011980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf77dc-a29c-4263-8221-7b20ff85044c None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:06.053481 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be3774-8c7c-4f66-bb35-96cc948aa988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:06.054206 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be3774-8c7c-4f66-bb35-96cc948aa988 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:06.055084 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be3774-8c7c-4f66-bb35-96cc948aa988 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:06.055084 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be3774-8c7c-4f66-bb35-96cc948aa988 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:06.055481 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be3774-8c7c-4f66-bb35-96cc948aa988 None admin] RBAC: Adding query filter params (name=image) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:06.055798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be3774-8c7c-4f66-bb35-96cc948aa988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:06.057268 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be3774-8c7c-4f66-bb35-96cc948aa988 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:06.062721 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 518/1024] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:06.069782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1bf0-b075-4564-8396-1b6d87dd4e9c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:06.085204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:06.186046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1bf0-b075-4564-8396-1b6d87dd4e9c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:06.225526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d076402-6b23-4cf6-acc6-eff061d6b657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:06.225526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d076402-6b23-4cf6-acc6-eff061d6b657 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:06.225526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d076402-6b23-4cf6-acc6-eff061d6b657 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:06.225526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d076402-6b23-4cf6-acc6-eff061d6b657 None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:06.227192 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d076402-6b23-4cf6-acc6-eff061d6b657 None admin] RBAC: Adding query filter params (type=image) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:06.227192 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d076402-6b23-4cf6-acc6-eff061d6b657 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:06.228314 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d076402-6b23-4cf6-acc6-eff061d6b657 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:06.234450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 507/1025] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:06.240265 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be3774-8c7c-4f66-bb35-96cc948aa988 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:06.310007 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:06.351841 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be3774-8c7c-4f66-bb35-96cc948aa988 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:06.403624 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83920487-3ae4-4e21-a2eb-9b037680e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:06.404326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83920487-3ae4-4e21-a2eb-9b037680e9db None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:06.404607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83920487-3ae4-4e21-a2eb-9b037680e9db None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:06.404891 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83920487-3ae4-4e21-a2eb-9b037680e9db None admin] PATH_INFO: `/v3/endpoints` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:06.405773 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83920487-3ae4-4e21-a2eb-9b037680e9db None admin] RBAC: Adding query filter params (interface=public, service_id=4b77d6526fd04eef9c529d746c1855ba, region_id=RegionOne) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:06.406092 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83920487-3ae4-4e21-a2eb-9b037680e9db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:06.407541 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83920487-3ae4-4e21-a2eb-9b037680e9db None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:06.413668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 519/1026] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 13:42:06 2022] GET /identity/v3/endpoints?service_id=4b77d6526fd04eef9c529d746c1855ba&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:06.419861 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d076402-6b23-4cf6-acc6-eff061d6b657 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:06.509264 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:06.538947 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d076402-6b23-4cf6-acc6-eff061d6b657 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:06.574348 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7857e8-4b86-42a8-b4ec-e15a9cf468bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:06.575066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7857e8-4b86-42a8-b4ec-e15a9cf468bc None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:06.575364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7857e8-4b86-42a8-b4ec-e15a9cf468bc None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:06.575647 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7857e8-4b86-42a8-b4ec-e15a9cf468bc None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:06.576375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7857e8-4b86-42a8-b4ec-e15a9cf468bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:06.577749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7857e8-4b86-42a8-b4ec-e15a9cf468bc None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:06.585480 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 508/1027] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 13:42:06 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:42:06.669573 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7be9dd-3930-4b05-88a7-0a82cdd8775d None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:06.669859 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7be9dd-3930-4b05-88a7-0a82cdd8775d None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:06.670307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7be9dd-3930-4b05-88a7-0a82cdd8775d None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:06.671982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 520/1028] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:06.677680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ed7af-d286-4161-8c96-508163aaffef None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:06.678504 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ed7af-d286-4161-8c96-508163aaffef None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:06.678792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ed7af-d286-4161-8c96-508163aaffef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:06.698075 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-134ed7af-d286-4161-8c96-508163aaffef None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:06.699357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-134ed7af-d286-4161-8c96-508163aaffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:06.788097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 509/1029] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:06.812769 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7be9dd-3930-4b05-88a7-0a82cdd8775d None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:06.932796 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7be9dd-3930-4b05-88a7-0a82cdd8775d None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:06.963228 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:06.970284 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dccfaa-f496-40f4-8249-7ce44d09033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:06.971096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dccfaa-f496-40f4-8249-7ce44d09033d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:06.971380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dccfaa-f496-40f4-8249-7ce44d09033d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:06.971652 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dccfaa-f496-40f4-8249-7ce44d09033d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:06.982758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dccfaa-f496-40f4-8249-7ce44d09033d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-61dccfaa-f496-40f4-8249-7ce44d09033d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:42:06.991369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:06.992407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:06.993313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:06.993313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:06.993313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:06.993313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:06.993313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:42:06.993313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:42:06.993313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:42:06.993313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:42:06.993313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:42:06.993313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:42:06.993313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:42:06.993313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:06.994616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 521/1030] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 13:42:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:06.998721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ed7af-d286-4161-8c96-508163aaffef None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:07.069844 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:07.105896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ed7af-d286-4161-8c96-508163aaffef None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:07.142008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1445cb4-3e7c-4471-9fe4-448b7d9847c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:07.142682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1445cb4-3e7c-4471-9fe4-448b7d9847c0 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:07.142964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1445cb4-3e7c-4471-9fe4-448b7d9847c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:07.143239 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1445cb4-3e7c-4471-9fe4-448b7d9847c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:07.143991 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1445cb4-3e7c-4471-9fe4-448b7d9847c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:07.144328 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1445cb4-3e7c-4471-9fe4-448b7d9847c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:07.145693 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1445cb4-3e7c-4471-9fe4-448b7d9847c0 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:07.154847 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 510/1031] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 13:42:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:07.160353 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dccfaa-f496-40f4-8249-7ce44d09033d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:07.267629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dccfaa-f496-40f4-8249-7ce44d09033d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:07.301748 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cd530-6c34-4ae3-bcb5-78cc15901d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:07.302595 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd530-6c34-4ae3-bcb5-78cc15901d38 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:07.303474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd530-6c34-4ae3-bcb5-78cc15901d38 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:07.303766 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd530-6c34-4ae3-bcb5-78cc15901d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:07.314764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cd530-6c34-4ae3-bcb5-78cc15901d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:07.316255 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cd530-6c34-4ae3-bcb5-78cc15901d38 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-0c8cd530-6c34-4ae3-bcb5-78cc15901d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:42:07.333259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:07.334221 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:07.335362 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:42:07.335362 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:42:07.335362 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:07.335362 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:07.336179 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 522/1032] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:07.340106 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1445cb4-3e7c-4471-9fe4-448b7d9847c0 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:07.447661 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1445cb4-3e7c-4471-9fe4-448b7d9847c0 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:07.478273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:07.485228 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130f63-3833-43f8-a386-4b72a54b6c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:07.485900 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130f63-3833-43f8-a386-4b72a54b6c39 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:07.486188 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130f63-3833-43f8-a386-4b72a54b6c39 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:07.486467 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130f63-3833-43f8-a386-4b72a54b6c39 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:07.487205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130f63-3833-43f8-a386-4b72a54b6c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:07.487514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130f63-3833-43f8-a386-4b72a54b6c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:07.488986 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130f63-3833-43f8-a386-4b72a54b6c39 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:07.505796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 511/1033] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:07.507281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cd530-6c34-4ae3-bcb5-78cc15901d38 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:07.554521 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:07.614844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cd530-6c34-4ae3-bcb5-78cc15901d38 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:07.649752 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd31240-ff57-4827-a337-58579db6d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:07.650554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd31240-ff57-4827-a337-58579db6d51b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:07.650833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd31240-ff57-4827-a337-58579db6d51b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:07.651103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd31240-ff57-4827-a337-58579db6d51b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:07.659052 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd31240-ff57-4827-a337-58579db6d51b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:07.660551 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd31240-ff57-4827-a337-58579db6d51b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-dcd31240-ff57-4827-a337-58579db6d51b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:42:07.675245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:07.676278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:07.677258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:07.677258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:07.677258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:42:07.677258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:42:07.677258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:42:07.677258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:42:07.677258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:42:07.677258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:42:07.677258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:42:07.677258 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:07.678473 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 523/1034] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 13:42:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:07.682124 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130f63-3833-43f8-a386-4b72a54b6c39 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:07.795465 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130f63-3833-43f8-a386-4b72a54b6c39 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:07.834228 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc72f18-5b66-44e6-8753-b6978b100df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:07.835404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72f18-5b66-44e6-8753-b6978b100df6 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:07.835691 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72f18-5b66-44e6-8753-b6978b100df6 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:07.835971 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72f18-5b66-44e6-8753-b6978b100df6 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:07.836861 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc72f18-5b66-44e6-8753-b6978b100df6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:07.837179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc72f18-5b66-44e6-8753-b6978b100df6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:07.838641 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc72f18-5b66-44e6-8753-b6978b100df6 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:07.857313 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 512/1035] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 13:42:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:07.862776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd31240-ff57-4827-a337-58579db6d51b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:07.970521 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd31240-ff57-4827-a337-58579db6d51b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:07.972097 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:08.010335 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253c6b-7d7d-468d-be99-040d75fcb4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:08.011021 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253c6b-7d7d-468d-be99-040d75fcb4bc None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:08.011309 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253c6b-7d7d-468d-be99-040d75fcb4bc None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:08.011591 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253c6b-7d7d-468d-be99-040d75fcb4bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:08.082557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68253c6b-7d7d-468d-be99-040d75fcb4bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:08.084032 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68253c6b-7d7d-468d-be99-040d75fcb4bc None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:08.191479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 524/1036] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:42:07 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:42:08.191673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790b3ae-38bd-457d-a393-3438e3fe296d None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:08.191673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790b3ae-38bd-457d-a393-3438e3fe296d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:08.191673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790b3ae-38bd-457d-a393-3438e3fe296d None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:08.191921 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253c6b-7d7d-468d-be99-040d75fcb4bc None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:08.191996 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 513/1037] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:08.192541 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:08.197825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabe0db-b886-40c1-97d1-d6c0f5ce74c0 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:08.198164 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabe0db-b886-40c1-97d1-d6c0f5ce74c0 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:08.198444 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabe0db-b886-40c1-97d1-d6c0f5ce74c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:08.217039 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-9aabe0db-b886-40c1-97d1-d6c0f5ce74c0 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:08.218252 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-9aabe0db-b886-40c1-97d1-d6c0f5ce74c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:08.266738 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:08.292996 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 514/1038] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:42:08.299923 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253c6b-7d7d-468d-be99-040d75fcb4bc None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:08.317695 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabe0db-b886-40c1-97d1-d6c0f5ce74c0 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:08.337977 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b78e3-b2aa-4485-9cee-cc3105ba72b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:08.339119 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b78e3-b2aa-4485-9cee-cc3105ba72b6 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:08.339652 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b78e3-b2aa-4485-9cee-cc3105ba72b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:08.340166 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b78e3-b2aa-4485-9cee-cc3105ba72b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:08.352593 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b78e3-b2aa-4485-9cee-cc3105ba72b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:08.354338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b78e3-b2aa-4485-9cee-cc3105ba72b6 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-4f3b78e3-b2aa-4485-9cee-cc3105ba72b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:42:08.373904 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:08.374980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:08.376057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:42:08.376057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:42:08.376057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:08.376057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:08.377793 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 525/1039] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:42:08.383923 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b78e3-b2aa-4485-9cee-cc3105ba72b6 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:08.433909 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabe0db-b886-40c1-97d1-d6c0f5ce74c0 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:08.445158 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:08.480398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80888a8-75b9-4d90-8725-0f38380a60ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:08.481202 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80888a8-75b9-4d90-8725-0f38380a60ad None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:08.481499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80888a8-75b9-4d90-8725-0f38380a60ad None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:08.481761 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80888a8-75b9-4d90-8725-0f38380a60ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:08.483067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80888a8-75b9-4d90-8725-0f38380a60ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:08.484678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80888a8-75b9-4d90-8725-0f38380a60ad None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:08.491324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 515/1040] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:08.492239 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80888a8-75b9-4d90-8725-0f38380a60ad None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:08.500135 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b78e3-b2aa-4485-9cee-cc3105ba72b6 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:08.538234 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf5a0e-f8da-470a-9a2b-8056ebcfb2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:08.539016 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf5a0e-f8da-470a-9a2b-8056ebcfb2b1 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:08.539247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf5a0e-f8da-470a-9a2b-8056ebcfb2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:08.539529 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf5a0e-f8da-470a-9a2b-8056ebcfb2b1 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:08.540303 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf5a0e-f8da-470a-9a2b-8056ebcfb2b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:08.540620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf5a0e-f8da-470a-9a2b-8056ebcfb2b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:08.542028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf5a0e-f8da-470a-9a2b-8056ebcfb2b1 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:08.543478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:08.559508 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 526/1041] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:08.560605 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf5a0e-f8da-470a-9a2b-8056ebcfb2b1 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:08.609349 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80888a8-75b9-4d90-8725-0f38380a60ad None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:08.646618 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9006e9-d42d-42e7-b10b-e2ce5a2e3703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:08.648291 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9006e9-d42d-42e7-b10b-e2ce5a2e3703 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:08.648583 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9006e9-d42d-42e7-b10b-e2ce5a2e3703 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:08.648867 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9006e9-d42d-42e7-b10b-e2ce5a2e3703 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:08.649671 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9006e9-d42d-42e7-b10b-e2ce5a2e3703 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:08.651060 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9006e9-d42d-42e7-b10b-e2ce5a2e3703 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:08.684146 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 516/1042] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:42:08 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:42:08.684371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf5a0e-f8da-470a-9a2b-8056ebcfb2b1 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:08.697570 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:08.734676 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500d558-22f9-4708-8a53-373c6b9a196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:08.735535 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500d558-22f9-4708-8a53-373c6b9a196b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:08.735821 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500d558-22f9-4708-8a53-373c6b9a196b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:08.736097 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500d558-22f9-4708-8a53-373c6b9a196b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:08.753935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500d558-22f9-4708-8a53-373c6b9a196b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:08.755654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500d558-22f9-4708-8a53-373c6b9a196b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-7500d558-22f9-4708-8a53-373c6b9a196b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:42:08.774245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:08.775324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:08.781311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:42:08.781311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:42:08.781311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:42:08.781311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:42:08.781311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:42:08.781311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:42:08.781311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:42:08.781311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:08.781311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 527/1043] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:08.781830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9006e9-d42d-42e7-b10b-e2ce5a2e3703 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:08.878263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce20783-036d-4a79-a73c-11284f8faf2a None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:08.878596 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce20783-036d-4a79-a73c-11284f8faf2a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:08.878869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce20783-036d-4a79-a73c-11284f8faf2a None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:08.880290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 528/1044] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:08.886667 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3214-f6ac-45ed-ac4d-5c0b8e06fb4a None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:08.886939 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3214-f6ac-45ed-ac4d-5c0b8e06fb4a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:08.887222 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3214-f6ac-45ed-ac4d-5c0b8e06fb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:08.898834 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9006e9-d42d-42e7-b10b-e2ce5a2e3703 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:08.901474 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:08.910997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-8a0f3214-f6ac-45ed-ac4d-5c0b8e06fb4a None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:08.912850 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-8a0f3214-f6ac-45ed-ac4d-5c0b8e06fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:08.946421 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484a04f-3452-4260-a387-440cb85e1e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:08.947364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484a04f-3452-4260-a387-440cb85e1e2d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:08.947658 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484a04f-3452-4260-a387-440cb85e1e2d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:08.947933 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484a04f-3452-4260-a387-440cb85e1e2d None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:08.948956 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484a04f-3452-4260-a387-440cb85e1e2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:08.949271 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484a04f-3452-4260-a387-440cb85e1e2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:08.951357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484a04f-3452-4260-a387-440cb85e1e2d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:08.967423 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 517/1045] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:08.974118 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484a04f-3452-4260-a387-440cb85e1e2d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:08.993433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 529/1046] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:42:09.016715 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f3214-f6ac-45ed-ac4d-5c0b8e06fb4a None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:09.088369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484a04f-3452-4260-a387-440cb85e1e2d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:09.128582 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871d355-b99e-4ae1-9aa6-5b57bc0b4107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:09.129156 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871d355-b99e-4ae1-9aa6-5b57bc0b4107 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:09.129438 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871d355-b99e-4ae1-9aa6-5b57bc0b4107 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:09.129713 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871d355-b99e-4ae1-9aa6-5b57bc0b4107 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:09.130555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871d355-b99e-4ae1-9aa6-5b57bc0b4107 None admin] RBAC: Adding query filter params (role.id=53a0e5251cb44b8aa29d218cd5a19860, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=971eae8a8ad44ce893c311b74acbd76b) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:09.131523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871d355-b99e-4ae1-9aa6-5b57bc0b4107 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:09.133480 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871d355-b99e-4ae1-9aa6-5b57bc0b4107 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:09.148151 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 518/1047] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:42:08 2022] GET /identity/v3/role_assignments?user.id=971eae8a8ad44ce893c311b74acbd76b&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=53a0e5251cb44b8aa29d218cd5a19860 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:09.154805 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f3214-f6ac-45ed-ac4d-5c0b8e06fb4a None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:09.158833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:09.200292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa899ae-af0f-48db-a871-e72dd9a828c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:09.201114 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa899ae-af0f-48db-a871-e72dd9a828c7 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:09.201396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa899ae-af0f-48db-a871-e72dd9a828c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:09.201670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa899ae-af0f-48db-a871-e72dd9a828c7 None admin] PATH_INFO: `/v3/services/image` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:09.202349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa899ae-af0f-48db-a871-e72dd9a828c7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:09.203791 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa899ae-af0f-48db-a871-e72dd9a828c7 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-efa899ae-af0f-48db-a871-e72dd9a828c7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:09.217556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:09.219128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:09.224736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 530/1048] 10.222.0.24 () {56 vars in 1105 bytes} [Wed May 25 13:42:09 2022] GET /identity/v3/services/image => generated 86 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:42:09.229120 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871d355-b99e-4ae1-9aa6-5b57bc0b4107 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:09.262679 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:09.363967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871d355-b99e-4ae1-9aa6-5b57bc0b4107 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:09.405628 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb82ad3-3b72-4be0-82ca-7bafb3f0d52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:09.406246 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb82ad3-3b72-4be0-82ca-7bafb3f0d52e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:09.406573 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb82ad3-3b72-4be0-82ca-7bafb3f0d52e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:09.406851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb82ad3-3b72-4be0-82ca-7bafb3f0d52e None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:09.407573 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb82ad3-3b72-4be0-82ca-7bafb3f0d52e None admin] RBAC: Adding query filter params (name=image) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:09.407889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb82ad3-3b72-4be0-82ca-7bafb3f0d52e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:09.409411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb82ad3-3b72-4be0-82ca-7bafb3f0d52e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:09.421337 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 519/1049] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:09.422811 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa899ae-af0f-48db-a871-e72dd9a828c7 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:09.549670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa899ae-af0f-48db-a871-e72dd9a828c7 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:09.585967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc1143-f19f-46b0-9823-1ad8b63898f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:09.586639 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc1143-f19f-46b0-9823-1ad8b63898f5 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:09.586923 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc1143-f19f-46b0-9823-1ad8b63898f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:09.587201 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc1143-f19f-46b0-9823-1ad8b63898f5 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:09.587914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc1143-f19f-46b0-9823-1ad8b63898f5 None admin] RBAC: Adding query filter params (type=image) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:09.588253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc1143-f19f-46b0-9823-1ad8b63898f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:09.589649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc1143-f19f-46b0-9823-1ad8b63898f5 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:09.600485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 531/1050] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:09.602173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb82ad3-3b72-4be0-82ca-7bafb3f0d52e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:09.707041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:09.720382 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb82ad3-3b72-4be0-82ca-7bafb3f0d52e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:09.756638 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943aa81-0ce7-434c-94f1-c36b10f00ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:09.757414 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943aa81-0ce7-434c-94f1-c36b10f00ee7 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:09.757701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943aa81-0ce7-434c-94f1-c36b10f00ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:09.757977 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943aa81-0ce7-434c-94f1-c36b10f00ee7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:09.758725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943aa81-0ce7-434c-94f1-c36b10f00ee7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:09.760122 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943aa81-0ce7-434c-94f1-c36b10f00ee7 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:09.779798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 520/1051] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 13:42:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:42:11.034533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c1c33-0e8d-4848-b11f-e53c8b1e500a None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:11.035036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c1c33-0e8d-4848-b11f-e53c8b1e500a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:11.035036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c1c33-0e8d-4848-b11f-e53c8b1e500a None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:11.036455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 532/1052] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:11.042726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a2567-ddb0-42dc-a1c2-b4af64e29355 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:11.043184 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a2567-ddb0-42dc-a1c2-b4af64e29355 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:11.043390 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a2567-ddb0-42dc-a1c2-b4af64e29355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:11.061635 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-356a2567-ddb0-42dc-a1c2-b4af64e29355 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:11.062843 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-356a2567-ddb0-42dc-a1c2-b4af64e29355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:11.139927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 521/1053] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:11.164649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c1c33-0e8d-4848-b11f-e53c8b1e500a None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:11.200933 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:11.278800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c1c33-0e8d-4848-b11f-e53c8b1e500a None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:11.313328 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e97aea-d90c-40a7-845f-ddda7bc55258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:11.314035 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e97aea-d90c-40a7-845f-ddda7bc55258 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:11.314318 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e97aea-d90c-40a7-845f-ddda7bc55258 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:11.314591 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e97aea-d90c-40a7-845f-ddda7bc55258 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:11.325909 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e97aea-d90c-40a7-845f-ddda7bc55258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-c8e97aea-d90c-40a7-845f-ddda7bc55258 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:42:11.333674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:11.334656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:11.335513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:11.335513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:11.335513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:11.335513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:11.335513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:42:11.335513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:42:11.335513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:42:11.335513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:42:11.335513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:42:11.335513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:42:11.335513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:42:11.335513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:11.339555 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 533/1054] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:42:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:11.341135 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a2567-ddb0-42dc-a1c2-b4af64e29355 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:11.395601 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ccc40-0e1d-4643-94ed-ceb49f5465db None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:11.395928 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ccc40-0e1d-4643-94ed-ceb49f5465db None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:11.396414 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ccc40-0e1d-4643-94ed-ceb49f5465db None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:11.398482 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 534/1055] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:42:11.404631 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119760a-c334-45ec-9e5c-b5b7ade564bd None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:11.404961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119760a-c334-45ec-9e5c-b5b7ade564bd None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:11.405252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119760a-c334-45ec-9e5c-b5b7ade564bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:11.425558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-2119760a-c334-45ec-9e5c-b5b7ade564bd None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:11.426998 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-2119760a-c334-45ec-9e5c-b5b7ade564bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:11.428704 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:11.478138 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a2567-ddb0-42dc-a1c2-b4af64e29355 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:11.515621 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 535/1056] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:42:11.517649 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5ad74-e8b2-4a62-a740-c8de13a93580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:11.518325 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5ad74-e8b2-4a62-a740-c8de13a93580 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:11.518610 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5ad74-e8b2-4a62-a740-c8de13a93580 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:11.518899 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5ad74-e8b2-4a62-a740-c8de13a93580 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:11.519675 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5ad74-e8b2-4a62-a740-c8de13a93580 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:11.519969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5ad74-e8b2-4a62-a740-c8de13a93580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:11.521600 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5ad74-e8b2-4a62-a740-c8de13a93580 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:11.530614 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 522/1057] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:42:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:11.538484 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119760a-c334-45ec-9e5c-b5b7ade564bd None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:11.542731 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5ad74-e8b2-4a62-a740-c8de13a93580 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:11.564232 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:11.657096 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5ad74-e8b2-4a62-a740-c8de13a93580 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:11.663673 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119760a-c334-45ec-9e5c-b5b7ade564bd None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:11.693301 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4889e2-2115-409f-aa46-a85f055e1396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:11.694114 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4889e2-2115-409f-aa46-a85f055e1396 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:11.694949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4889e2-2115-409f-aa46-a85f055e1396 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:11.695237 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4889e2-2115-409f-aa46-a85f055e1396 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:11.697381 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:11.708561 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4889e2-2115-409f-aa46-a85f055e1396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-1e4889e2-2115-409f-aa46-a85f055e1396 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:42:11.717496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:11.718500 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:11.719357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 523/1058] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 13:42:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:42:11.726226 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4889e2-2115-409f-aa46-a85f055e1396 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:11.730412 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b8d38-974a-4d25-a8a6-77d7e4acff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:11.731489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b8d38-974a-4d25-a8a6-77d7e4acff9f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:11.731837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b8d38-974a-4d25-a8a6-77d7e4acff9f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:11.732132 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b8d38-974a-4d25-a8a6-77d7e4acff9f None admin] PATH_INFO: `/v3/users/d5b3b8275cd64d518245ad107ff78001` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:11.746814 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b8d38-974a-4d25-a8a6-77d7e4acff9f None admin] RBAC: Authorizing `identity:get_user(user_id=d5b3b8275cd64d518245ad107ff78001)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:11.748685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b8d38-974a-4d25-a8a6-77d7e4acff9f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:11.750209 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 536/1059] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:42:11 2022] GET /identity/v3/users/d5b3b8275cd64d518245ad107ff78001 => generated 285 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:11.757726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b8d38-974a-4d25-a8a6-77d7e4acff9f None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:11.848055 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:11.849936 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4889e2-2115-409f-aa46-a85f055e1396 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:11.873394 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b8d38-974a-4d25-a8a6-77d7e4acff9f None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:11.902403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed743a7-10d3-4264-b916-b6bc34ce7eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:11.903105 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed743a7-10d3-4264-b916-b6bc34ce7eee None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:11.903393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed743a7-10d3-4264-b916-b6bc34ce7eee None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:11.903675 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed743a7-10d3-4264-b916-b6bc34ce7eee None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:11.904559 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed743a7-10d3-4264-b916-b6bc34ce7eee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:11.904939 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed743a7-10d3-4264-b916-b6bc34ce7eee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:11.906337 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed743a7-10d3-4264-b916-b6bc34ce7eee None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:11.921028 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 524/1060] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 13:42:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:11.922582 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed743a7-10d3-4264-b916-b6bc34ce7eee None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:11.931766 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d5016-8968-4b30-87b3-88a80580b26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:11.932469 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d5016-8968-4b30-87b3-88a80580b26c None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:11.932754 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d5016-8968-4b30-87b3-88a80580b26c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:11.933029 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d5016-8968-4b30-87b3-88a80580b26c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:11.994866 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:12.008015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d5016-8968-4b30-87b3-88a80580b26c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:12.009241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d5016-8968-4b30-87b3-88a80580b26c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:12.049284 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed743a7-10d3-4264-b916-b6bc34ce7eee None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:12.088200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c149e9-5ab1-4cff-a9e6-39ca61ae7d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:12.089010 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c149e9-5ab1-4cff-a9e6-39ca61ae7d5a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:12.089296 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c149e9-5ab1-4cff-a9e6-39ca61ae7d5a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:12.089566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c149e9-5ab1-4cff-a9e6-39ca61ae7d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:12.098043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:12.101860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c149e9-5ab1-4cff-a9e6-39ca61ae7d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:12.103250 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c149e9-5ab1-4cff-a9e6-39ca61ae7d5a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-b9c149e9-5ab1-4cff-a9e6-39ca61ae7d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:42:12.120855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:12.121963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:12.123085 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:42:12.123085 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:42:12.123085 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:12.123085 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:12.123085 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 525/1061] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:12.123423 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915756ef-3650-4fa6-b841-704a7f6efde9 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:12.123569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915756ef-3650-4fa6-b841-704a7f6efde9 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:12.123842 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915756ef-3650-4fa6-b841-704a7f6efde9 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:12.125306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 526/1062] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:12.127941 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915756ef-3650-4fa6-b841-704a7f6efde9 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:12.132689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 537/1063] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:42:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 13:42:12.139363 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9287d-0f81-4372-9a60-5f7591343845 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:12.139676 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9287d-0f81-4372-9a60-5f7591343845 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:12.139954 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9287d-0f81-4372-9a60-5f7591343845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:12.157698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-22e9287d-0f81-4372-9a60-5f7591343845 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:12.158893 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-22e9287d-0f81-4372-9a60-5f7591343845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:12.232037 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 538/1064] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:12.232037 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9287d-0f81-4372-9a60-5f7591343845 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:12.247558 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915756ef-3650-4fa6-b841-704a7f6efde9 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:12.257536 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:12.283097 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bce840-80a5-4def-b364-b57055d14211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:12.283760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bce840-80a5-4def-b364-b57055d14211 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:12.284037 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bce840-80a5-4def-b364-b57055d14211 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:12.284348 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bce840-80a5-4def-b364-b57055d14211 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:12.285068 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bce840-80a5-4def-b364-b57055d14211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:12.285438 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bce840-80a5-4def-b364-b57055d14211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:12.286861 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bce840-80a5-4def-b364-b57055d14211 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:12.299373 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 527/1065] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:12.300226 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bce840-80a5-4def-b364-b57055d14211 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:12.346406 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9287d-0f81-4372-9a60-5f7591343845 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:12.358759 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:12.391400 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa45db4-0a21-4d0c-bc21-f85f8be8789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:12.392335 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa45db4-0a21-4d0c-bc21-f85f8be8789c None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:12.392623 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa45db4-0a21-4d0c-bc21-f85f8be8789c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:12.392899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa45db4-0a21-4d0c-bc21-f85f8be8789c None admin] PATH_INFO: `/v3/projects/9df91c3f18fe48e8b7d677b664784b5e` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:12.394418 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa45db4-0a21-4d0c-bc21-f85f8be8789c None admin] RBAC: Authorizing `identity:get_project(project_id=9df91c3f18fe48e8b7d677b664784b5e)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:12.397162 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa45db4-0a21-4d0c-bc21-f85f8be8789c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:12.399700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 539/1066] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:42:12 2022] GET /identity/v3/projects/9df91c3f18fe48e8b7d677b664784b5e => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:12.401403 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa45db4-0a21-4d0c-bc21-f85f8be8789c None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:12.425020 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bce840-80a5-4def-b364-b57055d14211 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:12.470790 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f58e06-7c35-4f11-9ee7-5dff2ce159e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:12.471460 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f58e06-7c35-4f11-9ee7-5dff2ce159e1 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:12.471743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f58e06-7c35-4f11-9ee7-5dff2ce159e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:12.472015 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f58e06-7c35-4f11-9ee7-5dff2ce159e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:12.510581 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:12.516930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa45db4-0a21-4d0c-bc21-f85f8be8789c None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:12.547810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f58e06-7c35-4f11-9ee7-5dff2ce159e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:12.549327 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f58e06-7c35-4f11-9ee7-5dff2ce159e1 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:12.554439 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051827b-1d2b-4970-bd00-5ba0e445b26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:12.555250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051827b-1d2b-4970-bd00-5ba0e445b26a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:12.555537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051827b-1d2b-4970-bd00-5ba0e445b26a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:12.555815 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051827b-1d2b-4970-bd00-5ba0e445b26a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:12.563954 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051827b-1d2b-4970-bd00-5ba0e445b26a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:12.565476 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051827b-1d2b-4970-bd00-5ba0e445b26a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-f051827b-1d2b-4970-bd00-5ba0e445b26a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:42:12.581326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:12.582429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:12.583396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:12.583396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:12.583396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:42:12.583396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:42:12.583396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:42:12.583396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:42:12.583396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:42:12.583396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:42:12.583396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:42:12.583396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:12.583396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 540/1067] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 13:42:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:12.583396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051827b-1d2b-4970-bd00-5ba0e445b26a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:12.630245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:12.662854 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 528/1068] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:42:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:42:12.663810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f58e06-7c35-4f11-9ee7-5dff2ce159e1 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:12.692826 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051827b-1d2b-4970-bd00-5ba0e445b26a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:12.729787 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de9256-d1ec-49f0-bbdf-bc3e2d12dbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:12.730455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de9256-d1ec-49f0-bbdf-bc3e2d12dbbc None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:12.730792 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de9256-d1ec-49f0-bbdf-bc3e2d12dbbc None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:12.731027 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de9256-d1ec-49f0-bbdf-bc3e2d12dbbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:12.731872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de9256-d1ec-49f0-bbdf-bc3e2d12dbbc None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=9df91c3f18fe48e8b7d677b664784b5e, user.id=d5b3b8275cd64d518245ad107ff78001) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:12.732218 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de9256-d1ec-49f0-bbdf-bc3e2d12dbbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:12.733766 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de9256-d1ec-49f0-bbdf-bc3e2d12dbbc None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:12.737914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:12.745636 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 541/1069] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:42:12 2022] GET /identity/v3/role_assignments?user.id=d5b3b8275cd64d518245ad107ff78001&scope.project.id=9df91c3f18fe48e8b7d677b664784b5e&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:12.746402 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de9256-d1ec-49f0-bbdf-bc3e2d12dbbc None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:12.785365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f58e06-7c35-4f11-9ee7-5dff2ce159e1 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:12.824825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051132d2-8007-4277-bf7b-a16e71dfdc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:12.825509 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051132d2-8007-4277-bf7b-a16e71dfdc88 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:12.825797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051132d2-8007-4277-bf7b-a16e71dfdc88 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:12.826076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051132d2-8007-4277-bf7b-a16e71dfdc88 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:12.826994 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051132d2-8007-4277-bf7b-a16e71dfdc88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:12.827339 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051132d2-8007-4277-bf7b-a16e71dfdc88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:12.829021 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051132d2-8007-4277-bf7b-a16e71dfdc88 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:12.860139 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 529/1070] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 13:42:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:12.863554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051132d2-8007-4277-bf7b-a16e71dfdc88 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:12.874606 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de9256-d1ec-49f0-bbdf-bc3e2d12dbbc None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:12.877272 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:12.919358 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007d869-9e84-40fa-8699-7514b8ffef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:12.920085 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007d869-9e84-40fa-8699-7514b8ffef59 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:12.920401 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007d869-9e84-40fa-8699-7514b8ffef59 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:12.920675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007d869-9e84-40fa-8699-7514b8ffef59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:12.934034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007d869-9e84-40fa-8699-7514b8ffef59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:12.935529 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007d869-9e84-40fa-8699-7514b8ffef59 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-9007d869-9e84-40fa-8699-7514b8ffef59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:42:12.954875 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:12.955851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:12.956795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:42:12.956795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:42:12.956795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:12.956795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:12.956795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 542/1071] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:12.963193 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007d869-9e84-40fa-8699-7514b8ffef59 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:12.982383 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051132d2-8007-4277-bf7b-a16e71dfdc88 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:13.011524 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:13.022157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767626b-0a0a-40fc-9ffc-29cd7b905ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:13.023239 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767626b-0a0a-40fc-9ffc-29cd7b905ee4 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:13.023523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767626b-0a0a-40fc-9ffc-29cd7b905ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:13.023795 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767626b-0a0a-40fc-9ffc-29cd7b905ee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:13.034427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767626b-0a0a-40fc-9ffc-29cd7b905ee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:13.036061 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767626b-0a0a-40fc-9ffc-29cd7b905ee4 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-f767626b-0a0a-40fc-9ffc-29cd7b905ee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:42:13.058289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:13.066656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:13.068860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:42:13.068860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:42:13.068860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:13.068860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:13.068860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 530/1072] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:42:13.068860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767626b-0a0a-40fc-9ffc-29cd7b905ee4 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:13.086635 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007d869-9e84-40fa-8699-7514b8ffef59 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:13.136488 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2574975-df14-4df2-a1a4-5f670dab0688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:13.137269 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2574975-df14-4df2-a1a4-5f670dab0688 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:13.137644 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2574975-df14-4df2-a1a4-5f670dab0688 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:13.138002 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2574975-df14-4df2-a1a4-5f670dab0688 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:13.138812 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2574975-df14-4df2-a1a4-5f670dab0688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:13.139195 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2574975-df14-4df2-a1a4-5f670dab0688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:13.140636 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2574975-df14-4df2-a1a4-5f670dab0688 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:13.155926 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 543/1073] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:13.218221 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767626b-0a0a-40fc-9ffc-29cd7b905ee4 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:13.260935 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c3cb6-06e9-42dd-ac66-89dbdd541f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:13.261903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3cb6-06e9-42dd-ac66-89dbdd541f98 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:13.262346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3cb6-06e9-42dd-ac66-89dbdd541f98 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:13.262780 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3cb6-06e9-42dd-ac66-89dbdd541f98 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:13.263727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c3cb6-06e9-42dd-ac66-89dbdd541f98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:13.264254 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c3cb6-06e9-42dd-ac66-89dbdd541f98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:13.265837 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c3cb6-06e9-42dd-ac66-89dbdd541f98 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:13.284552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 531/1074] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:13.286399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2574975-df14-4df2-a1a4-5f670dab0688 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:13.304270 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:13.403624 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2574975-df14-4df2-a1a4-5f670dab0688 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:13.439546 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687e1b4-b778-4866-bee9-ce3a18c50670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:13.440698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687e1b4-b778-4866-bee9-ce3a18c50670 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:13.441160 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687e1b4-b778-4866-bee9-ce3a18c50670 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:13.441597 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687e1b4-b778-4866-bee9-ce3a18c50670 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:13.449764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687e1b4-b778-4866-bee9-ce3a18c50670 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:13.451546 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687e1b4-b778-4866-bee9-ce3a18c50670 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-e687e1b4-b778-4866-bee9-ce3a18c50670 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:42:13.466331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:13.467374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:13.469518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:42:13.469518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:42:13.469518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:42:13.469518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:42:13.469518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:42:13.469518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:42:13.469518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:42:13.469518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:13.469518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 544/1075] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:42:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:13.474681 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c3cb6-06e9-42dd-ac66-89dbdd541f98 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:13.519905 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:13.581537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c3cb6-06e9-42dd-ac66-89dbdd541f98 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:13.615801 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23824083-c501-4681-a540-998dcd842c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:13.616493 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23824083-c501-4681-a540-998dcd842c3c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:13.616812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23824083-c501-4681-a540-998dcd842c3c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:13.617060 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23824083-c501-4681-a540-998dcd842c3c None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:13.617857 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23824083-c501-4681-a540-998dcd842c3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:13.618171 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23824083-c501-4681-a540-998dcd842c3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:13.619611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23824083-c501-4681-a540-998dcd842c3c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:13.632698 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 532/1076] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:13.638934 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687e1b4-b778-4866-bee9-ce3a18c50670 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:13.716726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:13.742974 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687e1b4-b778-4866-bee9-ce3a18c50670 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:13.776218 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d1948-9712-42ed-8111-b4bc0b429e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:13.777102 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d1948-9712-42ed-8111-b4bc0b429e27 None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:13.777388 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d1948-9712-42ed-8111-b4bc0b429e27 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:13.777663 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d1948-9712-42ed-8111-b4bc0b429e27 None admin] PATH_INFO: `/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/971eae8a8ad44ce893c311b74acbd76b/roles/53a0e5251cb44b8aa29d218cd5a19860` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:13.779857 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d1948-9712-42ed-8111-b4bc0b429e27 None admin] RBAC: Authorizing `identity:create_grant(project_id=b57fe974dc4d4542a1dd930fc6912d39, user_id=971eae8a8ad44ce893c311b74acbd76b, role_id=53a0e5251cb44b8aa29d218cd5a19860)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:13.781328 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d1948-9712-42ed-8111-b4bc0b429e27 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:13.795072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 545/1077] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:42:13 2022] PUT /identity/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/971eae8a8ad44ce893c311b74acbd76b/roles/53a0e5251cb44b8aa29d218cd5a19860 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:42:14.997802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29118bb2-6b95-4e57-8bd9-ff838d6b68bc None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:14.998652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29118bb2-6b95-4e57-8bd9-ff838d6b68bc None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:14.998652 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29118bb2-6b95-4e57-8bd9-ff838d6b68bc None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:14.999817 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 533/1078] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:15.006316 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a462dfa-5348-496a-9a30-46819c86443e None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:15.006832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a462dfa-5348-496a-9a30-46819c86443e None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:15.006927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a462dfa-5348-496a-9a30-46819c86443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:15.023842 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-7a462dfa-5348-496a-9a30-46819c86443e None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:15.025102 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-7a462dfa-5348-496a-9a30-46819c86443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:15.093976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 546/1079] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:42:15.117207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29118bb2-6b95-4e57-8bd9-ff838d6b68bc None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:15.225617 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:15.231614 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29118bb2-6b95-4e57-8bd9-ff838d6b68bc None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:15.266629 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f07743-477c-4ed0-87ed-5dff70ad51ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:15.267331 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f07743-477c-4ed0-87ed-5dff70ad51ac None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:15.267612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f07743-477c-4ed0-87ed-5dff70ad51ac None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:15.267886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f07743-477c-4ed0-87ed-5dff70ad51ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:15.279423 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f07743-477c-4ed0-87ed-5dff70ad51ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-29f07743-477c-4ed0-87ed-5dff70ad51ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:42:15.287534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:15.288869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:15.290805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 534/1080] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:42:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:15.294944 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a462dfa-5348-496a-9a30-46819c86443e None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:15.363830 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:15.410130 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a462dfa-5348-496a-9a30-46819c86443e None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:15.447396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37c1a-f08f-4758-b14b-2c736b360d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:15.448076 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37c1a-f08f-4758-b14b-2c736b360d0e None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:15.448385 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37c1a-f08f-4758-b14b-2c736b360d0e None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:15.448732 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37c1a-f08f-4758-b14b-2c736b360d0e None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:15.449491 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37c1a-f08f-4758-b14b-2c736b360d0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:15.449852 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37c1a-f08f-4758-b14b-2c736b360d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:15.451265 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37c1a-f08f-4758-b14b-2c736b360d0e None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:15.460721 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 547/1081] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:15.466691 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f07743-477c-4ed0-87ed-5dff70ad51ac None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:15.581565 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f07743-477c-4ed0-87ed-5dff70ad51ac None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:15.616797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1f2c7-d137-40db-a3f4-3f47f35d506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:15.617679 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1f2c7-d137-40db-a3f4-3f47f35d506f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:15.617959 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1f2c7-d137-40db-a3f4-3f47f35d506f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:15.618239 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1f2c7-d137-40db-a3f4-3f47f35d506f None admin] PATH_INFO: `/v3/users/d5b3b8275cd64d518245ad107ff78001` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:15.619493 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1f2c7-d137-40db-a3f4-3f47f35d506f None admin] RBAC: Authorizing `identity:get_user(user_id=d5b3b8275cd64d518245ad107ff78001)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:15.620977 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1f2c7-d137-40db-a3f4-3f47f35d506f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:15.622644 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 535/1082] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:42:15 2022] GET /identity/v3/users/d5b3b8275cd64d518245ad107ff78001 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:15.628419 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37c1a-f08f-4758-b14b-2c736b360d0e None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:15.748481 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37c1a-f08f-4758-b14b-2c736b360d0e None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:15.779117 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:15.788790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54069fbc-9735-47ca-8761-4fe0a1b99192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:15.789658 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54069fbc-9735-47ca-8761-4fe0a1b99192 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:15.789945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54069fbc-9735-47ca-8761-4fe0a1b99192 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:15.790223 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54069fbc-9735-47ca-8761-4fe0a1b99192 None admin] PATH_INFO: `/v3/projects/9df91c3f18fe48e8b7d677b664784b5e` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:15.791417 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54069fbc-9735-47ca-8761-4fe0a1b99192 None admin] RBAC: Authorizing `identity:get_project(project_id=9df91c3f18fe48e8b7d677b664784b5e)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:15.792906 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54069fbc-9735-47ca-8761-4fe0a1b99192 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:15.794651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 548/1083] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:42:15 2022] GET /identity/v3/projects/9df91c3f18fe48e8b7d677b664784b5e => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:15.800643 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1f2c7-d137-40db-a3f4-3f47f35d506f None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:15.832470 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:15.921610 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1f2c7-d137-40db-a3f4-3f47f35d506f None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:15.956549 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae8541-3776-4c46-8dd4-05325780a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:15.957445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae8541-3776-4c46-8dd4-05325780a4df None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:15.957725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae8541-3776-4c46-8dd4-05325780a4df None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:15.957997 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae8541-3776-4c46-8dd4-05325780a4df None admin] PATH_INFO: `/v3/projects/9df91c3f18fe48e8b7d677b664784b5e/users/d5b3b8275cd64d518245ad107ff78001/roles/109ea861e27e4d75bec3ac9c5f81096e` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:15.960130 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae8541-3776-4c46-8dd4-05325780a4df None admin] RBAC: Authorizing `identity:create_grant(project_id=9df91c3f18fe48e8b7d677b664784b5e, user_id=d5b3b8275cd64d518245ad107ff78001, role_id=109ea861e27e4d75bec3ac9c5f81096e)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:15.961567 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae8541-3776-4c46-8dd4-05325780a4df None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:15.975910 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 536/1084] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:42:15 2022] PUT /identity/v3/projects/9df91c3f18fe48e8b7d677b664784b5e/users/d5b3b8275cd64d518245ad107ff78001/roles/109ea861e27e4d75bec3ac9c5f81096e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:42:16.043715 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8108b-c157-4f81-b85c-0c67b08292f3 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:16.044295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8108b-c157-4f81-b85c-0c67b08292f3 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:16.044482 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8108b-c157-4f81-b85c-0c67b08292f3 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:16.046086 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 549/1085] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:16.052064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e82b12-d481-4791-8ceb-3bf56da8afa0 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:16.053265 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e82b12-d481-4791-8ceb-3bf56da8afa0 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:16.053404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e82b12-d481-4791-8ceb-3bf56da8afa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:16.072783 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-62e82b12-d481-4791-8ceb-3bf56da8afa0 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:16.073859 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-62e82b12-d481-4791-8ceb-3bf56da8afa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:16.151180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 537/1086] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:16.175236 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8108b-c157-4f81-b85c-0c67b08292f3 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:16.288318 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8108b-c157-4f81-b85c-0c67b08292f3 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:16.334406 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657272c-2d7d-4627-8ba4-b8479420b0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:16.335222 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657272c-2d7d-4627-8ba4-b8479420b0c1 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:16.335501 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657272c-2d7d-4627-8ba4-b8479420b0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:16.335772 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657272c-2d7d-4627-8ba4-b8479420b0c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:16.348095 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657272c-2d7d-4627-8ba4-b8479420b0c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-9657272c-2d7d-4627-8ba4-b8479420b0c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:42:16.356818 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:16.357858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:16.358737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 550/1087] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 13:42:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:16.365401 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e82b12-d481-4791-8ceb-3bf56da8afa0 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:16.383478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:16.481306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e82b12-d481-4791-8ceb-3bf56da8afa0 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:16.533814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33ee03-0405-461c-a6c5-f48f6aae2c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:16.534862 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ee03-0405-461c-a6c5-f48f6aae2c65 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:16.535245 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ee03-0405-461c-a6c5-f48f6aae2c65 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:16.535520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ee03-0405-461c-a6c5-f48f6aae2c65 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:16.537132 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33ee03-0405-461c-a6c5-f48f6aae2c65 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:16.537621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33ee03-0405-461c-a6c5-f48f6aae2c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:16.539977 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33ee03-0405-461c-a6c5-f48f6aae2c65 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:16.549746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 538/1088] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 13:42:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:16.556327 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657272c-2d7d-4627-8ba4-b8479420b0c1 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:16.616611 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:16.667751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657272c-2d7d-4627-8ba4-b8479420b0c1 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:16.705252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460b70f-4e78-4450-bdc4-18134cdc4cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:16.706142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460b70f-4e78-4450-bdc4-18134cdc4cb2 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:16.706494 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460b70f-4e78-4450-bdc4-18134cdc4cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:16.706770 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460b70f-4e78-4450-bdc4-18134cdc4cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:16.719902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460b70f-4e78-4450-bdc4-18134cdc4cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:16.724666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460b70f-4e78-4450-bdc4-18134cdc4cb2 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-e460b70f-4e78-4450-bdc4-18134cdc4cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:42:16.743986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:16.745707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:16.746628 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:42:16.746628 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:42:16.746628 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:16.746628 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:16.748448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 551/1089] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:16.751095 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33ee03-0405-461c-a6c5-f48f6aae2c65 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:16.843139 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:16.879525 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33ee03-0405-461c-a6c5-f48f6aae2c65 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:16.918666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d05fcc-ec34-485b-b225-c3692da97f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:16.919334 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d05fcc-ec34-485b-b225-c3692da97f95 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:16.919626 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d05fcc-ec34-485b-b225-c3692da97f95 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:16.919905 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d05fcc-ec34-485b-b225-c3692da97f95 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:16.920693 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d05fcc-ec34-485b-b225-c3692da97f95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:16.921002 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d05fcc-ec34-485b-b225-c3692da97f95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:16.922372 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d05fcc-ec34-485b-b225-c3692da97f95 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:16.935209 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 539/1090] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:16.941494 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460b70f-4e78-4450-bdc4-18134cdc4cb2 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:17.056938 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460b70f-4e78-4450-bdc4-18134cdc4cb2 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:17.064707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:17.096229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f57e54-ab89-4519-9604-5a48e94104f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:17.097044 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f57e54-ab89-4519-9604-5a48e94104f4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:17.097323 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f57e54-ab89-4519-9604-5a48e94104f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:17.097848 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f57e54-ab89-4519-9604-5a48e94104f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:17.107022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f57e54-ab89-4519-9604-5a48e94104f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:17.108552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f57e54-ab89-4519-9604-5a48e94104f4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-79f57e54-ab89-4519-9604-5a48e94104f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:42:17.125099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:17.127010 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:17.128982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:17.128982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:17.128982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:42:17.128982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:42:17.128982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:42:17.128982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:42:17.128982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:42:17.128982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:42:17.128982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:42:17.128982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:17.128982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 552/1091] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 13:42:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:17.133594 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d05fcc-ec34-485b-b225-c3692da97f95 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:17.249514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d05fcc-ec34-485b-b225-c3692da97f95 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:17.286407 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ce23a-14b5-48bd-b2b9-326743e1c50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:17.287204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ce23a-14b5-48bd-b2b9-326743e1c50a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:17.287489 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ce23a-14b5-48bd-b2b9-326743e1c50a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:17.287766 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ce23a-14b5-48bd-b2b9-326743e1c50a None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:17.288661 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ce23a-14b5-48bd-b2b9-326743e1c50a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:17.288980 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ce23a-14b5-48bd-b2b9-326743e1c50a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:17.290458 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ce23a-14b5-48bd-b2b9-326743e1c50a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:17.299380 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:17.311486 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 540/1092] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 13:42:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:17.317176 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f57e54-ab89-4519-9604-5a48e94104f4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:17.428768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f57e54-ab89-4519-9604-5a48e94104f4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:17.465735 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be0df5-cd7f-4759-ae7f-b23a3f8257be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:17.466385 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be0df5-cd7f-4759-ae7f-b23a3f8257be None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:17.466668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be0df5-cd7f-4759-ae7f-b23a3f8257be None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:17.466945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be0df5-cd7f-4759-ae7f-b23a3f8257be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:17.502821 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:17.542279 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be0df5-cd7f-4759-ae7f-b23a3f8257be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:17.543761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be0df5-cd7f-4759-ae7f-b23a3f8257be None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:17.657823 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 553/1093] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:42:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:42:17.663998 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ce23a-14b5-48bd-b2b9-326743e1c50a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:17.772409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ce23a-14b5-48bd-b2b9-326743e1c50a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:17.809185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc40496-4642-445a-be63-733a5459e75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:17.809972 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc40496-4642-445a-be63-733a5459e75c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:17.810255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc40496-4642-445a-be63-733a5459e75c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:17.810529 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc40496-4642-445a-be63-733a5459e75c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:17.822180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc40496-4642-445a-be63-733a5459e75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:17.823651 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc40496-4642-445a-be63-733a5459e75c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-fcc40496-4642-445a-be63-733a5459e75c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:42:17.843743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:17.851098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:17.853218 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:42:17.853218 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:42:17.853218 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:42:17.853218 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:17.853218 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 541/1094] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:17.853929 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be0df5-cd7f-4759-ae7f-b23a3f8257be None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:17.928319 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:17.965944 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be0df5-cd7f-4759-ae7f-b23a3f8257be None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:18.003189 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2eb621-1f0d-444f-9fa4-f43c0375777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:18.003861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eb621-1f0d-444f-9fa4-f43c0375777e None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:18.004175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eb621-1f0d-444f-9fa4-f43c0375777e None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:18.004458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eb621-1f0d-444f-9fa4-f43c0375777e None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:18.005752 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2eb621-1f0d-444f-9fa4-f43c0375777e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:18.006061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2eb621-1f0d-444f-9fa4-f43c0375777e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:18.007483 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2eb621-1f0d-444f-9fa4-f43c0375777e None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:18.019873 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 554/1095] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:18.026019 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc40496-4642-445a-be63-733a5459e75c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:18.082076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:18.141786 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc40496-4642-445a-be63-733a5459e75c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:18.181087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fccae6-881e-4871-9825-9db21e9378f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:18.181806 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fccae6-881e-4871-9825-9db21e9378f3 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:18.182084 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fccae6-881e-4871-9825-9db21e9378f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:18.182355 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fccae6-881e-4871-9825-9db21e9378f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:18.189682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fccae6-881e-4871-9825-9db21e9378f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:18.191139 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fccae6-881e-4871-9825-9db21e9378f3 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-d4fccae6-881e-4871-9825-9db21e9378f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:42:18.205851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:18.207569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:18.209914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:42:18.209914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:42:18.209914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:42:18.209914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:42:18.209914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:42:18.209914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:42:18.209914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:42:18.209914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:18.209914 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 542/1096] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:18.214239 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2eb621-1f0d-444f-9fa4-f43c0375777e None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:18.264088 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1364ee-2b64-4cae-84f8-0a52edea7684 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:18.264596 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1364ee-2b64-4cae-84f8-0a52edea7684 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:18.265006 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1364ee-2b64-4cae-84f8-0a52edea7684 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:18.267326 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 543/1097] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:18.274333 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76e4b-e55f-4415-bcbd-81f391037ba3 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:18.274798 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76e4b-e55f-4415-bcbd-81f391037ba3 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:18.275255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76e4b-e55f-4415-bcbd-81f391037ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:18.301530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-cba76e4b-e55f-4415-bcbd-81f391037ba3 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:18.304209 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-cba76e4b-e55f-4415-bcbd-81f391037ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:18.342005 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2eb621-1f0d-444f-9fa4-f43c0375777e None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:18.369465 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:18.383156 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a91ea-d0a7-442d-83f2-d5a1dd37a4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:18.384298 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a91ea-d0a7-442d-83f2-d5a1dd37a4e4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:18.384775 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a91ea-d0a7-442d-83f2-d5a1dd37a4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:18.385265 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a91ea-d0a7-442d-83f2-d5a1dd37a4e4 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:18.386659 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a91ea-d0a7-442d-83f2-d5a1dd37a4e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:18.387179 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a91ea-d0a7-442d-83f2-d5a1dd37a4e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:18.387759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 544/1098] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:42:18.389050 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a91ea-d0a7-442d-83f2-d5a1dd37a4e4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:18.403226 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 555/1099] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:18.409903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba76e4b-e55f-4415-bcbd-81f391037ba3 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:18.413565 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a91ea-d0a7-442d-83f2-d5a1dd37a4e4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:18.452529 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:18.525571 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba76e4b-e55f-4415-bcbd-81f391037ba3 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:18.529229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a91ea-d0a7-442d-83f2-d5a1dd37a4e4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:18.562966 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccf193-8afa-41ec-9b56-08e1513b94aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:18.563630 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccf193-8afa-41ec-9b56-08e1513b94aa None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:18.563915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccf193-8afa-41ec-9b56-08e1513b94aa None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:18.564226 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccf193-8afa-41ec-9b56-08e1513b94aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:18.564971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbb516-6959-4b6e-9c34-51c445bb42cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:18.565159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccf193-8afa-41ec-9b56-08e1513b94aa None admin] RBAC: Adding query filter params (role.id=53a0e5251cb44b8aa29d218cd5a19860, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=971eae8a8ad44ce893c311b74acbd76b) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:18.565373 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccf193-8afa-41ec-9b56-08e1513b94aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:18.565763 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbb516-6959-4b6e-9c34-51c445bb42cd None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:18.566046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbb516-6959-4b6e-9c34-51c445bb42cd None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:18.566319 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbb516-6959-4b6e-9c34-51c445bb42cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:18.566816 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccf193-8afa-41ec-9b56-08e1513b94aa None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:18.574415 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 545/1100] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:42:18 2022] GET /identity/v3/role_assignments?user.id=971eae8a8ad44ce893c311b74acbd76b&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=53a0e5251cb44b8aa29d218cd5a19860 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:18.580212 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbb516-6959-4b6e-9c34-51c445bb42cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-5efbb516-6959-4b6e-9c34-51c445bb42cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:42:18.589498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:18.591157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:18.593632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 556/1101] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:42:18.599357 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccf193-8afa-41ec-9b56-08e1513b94aa None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:18.724611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccf193-8afa-41ec-9b56-08e1513b94aa None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:18.726724 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:18.767173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101f0b5-5394-4d14-a02a-269e187b787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:18.767850 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101f0b5-5394-4d14-a02a-269e187b787d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:18.768146 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101f0b5-5394-4d14-a02a-269e187b787d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:18.768425 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101f0b5-5394-4d14-a02a-269e187b787d None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:18.769176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101f0b5-5394-4d14-a02a-269e187b787d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:18.769488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101f0b5-5394-4d14-a02a-269e187b787d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:18.771057 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101f0b5-5394-4d14-a02a-269e187b787d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:18.780700 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 546/1102] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:18.787532 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbb516-6959-4b6e-9c34-51c445bb42cd None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:18.840826 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:18.905458 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbb516-6959-4b6e-9c34-51c445bb42cd None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:18.949148 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e486d1-7066-42c0-a06d-358d1e76b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:18.950293 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e486d1-7066-42c0-a06d-358d1e76b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:18.950701 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e486d1-7066-42c0-a06d-358d1e76b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:18.951119 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e486d1-7066-42c0-a06d-358d1e76b5e7 None admin] PATH_INFO: `/v3/users/d5b3b8275cd64d518245ad107ff78001` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:18.953411 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e486d1-7066-42c0-a06d-358d1e76b5e7 None admin] RBAC: Authorizing `identity:get_user(user_id=d5b3b8275cd64d518245ad107ff78001)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:18.955742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e486d1-7066-42c0-a06d-358d1e76b5e7 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:18.959146 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 557/1103] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:42:18 2022] GET /identity/v3/users/d5b3b8275cd64d518245ad107ff78001 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:18.965764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101f0b5-5394-4d14-a02a-269e187b787d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:19.102508 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101f0b5-5394-4d14-a02a-269e187b787d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:19.140186 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8009ab-621b-4692-8dda-f7f6319c1f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:19.141029 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8009ab-621b-4692-8dda-f7f6319c1f22 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:19.141320 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8009ab-621b-4692-8dda-f7f6319c1f22 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:19.141689 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8009ab-621b-4692-8dda-f7f6319c1f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:19.179051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:19.221895 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8009ab-621b-4692-8dda-f7f6319c1f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:19.224447 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8009ab-621b-4692-8dda-f7f6319c1f22 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:19.355647 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 547/1104] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:42:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:42:19.362910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e486d1-7066-42c0-a06d-358d1e76b5e7 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:19.493433 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e486d1-7066-42c0-a06d-358d1e76b5e7 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:19.511751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:19.537714 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a174f4f-0d86-4d82-ad49-c3cd191a6d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:19.538591 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a174f4f-0d86-4d82-ad49-c3cd191a6d22 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:19.538876 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a174f4f-0d86-4d82-ad49-c3cd191a6d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:19.539153 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a174f4f-0d86-4d82-ad49-c3cd191a6d22 None admin] PATH_INFO: `/v3/projects/9df91c3f18fe48e8b7d677b664784b5e` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:19.540441 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a174f4f-0d86-4d82-ad49-c3cd191a6d22 None admin] RBAC: Authorizing `identity:get_project(project_id=9df91c3f18fe48e8b7d677b664784b5e)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:19.542292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a174f4f-0d86-4d82-ad49-c3cd191a6d22 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:19.543655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 558/1105] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:42:19 2022] GET /identity/v3/projects/9df91c3f18fe48e8b7d677b664784b5e => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:19.550150 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8009ab-621b-4692-8dda-f7f6319c1f22 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:19.633745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:19.679886 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8009ab-621b-4692-8dda-f7f6319c1f22 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:19.716683 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f016af-5e93-4571-aadf-686cd7d83a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:19.717351 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f016af-5e93-4571-aadf-686cd7d83a73 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:19.717633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f016af-5e93-4571-aadf-686cd7d83a73 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:19.718023 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f016af-5e93-4571-aadf-686cd7d83a73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:19.718763 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f016af-5e93-4571-aadf-686cd7d83a73 None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=9df91c3f18fe48e8b7d677b664784b5e, user.id=d5b3b8275cd64d518245ad107ff78001) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:19.719081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f016af-5e93-4571-aadf-686cd7d83a73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:19.720585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f016af-5e93-4571-aadf-686cd7d83a73 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:19.727621 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 548/1106] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:42:19 2022] GET /identity/v3/role_assignments?user.id=d5b3b8275cd64d518245ad107ff78001&scope.project.id=9df91c3f18fe48e8b7d677b664784b5e&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:22.033406 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9de209-58b2-4448-b7d8-24922d828803 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:22.033937 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9de209-58b2-4448-b7d8-24922d828803 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:22.033937 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9de209-58b2-4448-b7d8-24922d828803 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:22.035237 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 559/1107] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:22.041842 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3a49-76d7-4357-ad35-1158a1f36c96 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:22.042324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3a49-76d7-4357-ad35-1158a1f36c96 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:22.042437 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3a49-76d7-4357-ad35-1158a1f36c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:22.060981 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-cfdd3a49-76d7-4357-ad35-1158a1f36c96 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:22.062182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-cfdd3a49-76d7-4357-ad35-1158a1f36c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:22.136073 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 549/1108] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:22.162619 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9de209-58b2-4448-b7d8-24922d828803 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:22.280934 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9de209-58b2-4448-b7d8-24922d828803 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:22.325439 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575e4ad-c520-4c4a-9b5d-4386d885d469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:22.326133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575e4ad-c520-4c4a-9b5d-4386d885d469 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:22.326414 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575e4ad-c520-4c4a-9b5d-4386d885d469 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:22.326686 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575e4ad-c520-4c4a-9b5d-4386d885d469 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:22.327967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575e4ad-c520-4c4a-9b5d-4386d885d469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:22.329482 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575e4ad-c520-4c4a-9b5d-4386d885d469 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:22.331119 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 560/1109] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:22.338830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3a49-76d7-4357-ad35-1158a1f36c96 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:22.399606 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:22.443707 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3a49-76d7-4357-ad35-1158a1f36c96 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:22.481100 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1ae43-f982-47f2-91d6-ba08dee20e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:22.481775 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1ae43-f982-47f2-91d6-ba08dee20e23 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:22.482057 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1ae43-f982-47f2-91d6-ba08dee20e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:22.482336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1ae43-f982-47f2-91d6-ba08dee20e23 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:22.483074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1ae43-f982-47f2-91d6-ba08dee20e23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:22.484564 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1ae43-f982-47f2-91d6-ba08dee20e23 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:22.511523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 550/1110] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:42:22 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:42:24.928213 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737281c6-efbf-438b-bd39-f42a33a094f0 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:24.928771 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737281c6-efbf-438b-bd39-f42a33a094f0 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:24.928771 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737281c6-efbf-438b-bd39-f42a33a094f0 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:24.930140 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 561/1111] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:24.936310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080052ff-9a73-4a43-bddd-5eb42b778d48 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:24.937088 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080052ff-9a73-4a43-bddd-5eb42b778d48 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:24.937088 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080052ff-9a73-4a43-bddd-5eb42b778d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:24.954728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-080052ff-9a73-4a43-bddd-5eb42b778d48 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:24.955949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-080052ff-9a73-4a43-bddd-5eb42b778d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:25.032347 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 551/1112] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:25.057944 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737281c6-efbf-438b-bd39-f42a33a094f0 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:25.116078 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:25.174166 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737281c6-efbf-438b-bd39-f42a33a094f0 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:25.213252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ff56b-0aa1-4d08-b48f-6f9083cce115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:25.214123 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff56b-0aa1-4d08-b48f-6f9083cce115 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:25.214404 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff56b-0aa1-4d08-b48f-6f9083cce115 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:25.214678 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff56b-0aa1-4d08-b48f-6f9083cce115 None admin] PATH_INFO: `/v3/roles/97e1bde6953846e0b3e2204a9aa8868d` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:25.216203 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ff56b-0aa1-4d08-b48f-6f9083cce115 None admin] RBAC: Authorizing `identity:get_role(role_id=97e1bde6953846e0b3e2204a9aa8868d)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:25.217600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ff56b-0aa1-4d08-b48f-6f9083cce115 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:25.219001 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 562/1113] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:42:25 2022] GET /identity/v3/roles/97e1bde6953846e0b3e2204a9aa8868d => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:25.230228 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080052ff-9a73-4a43-bddd-5eb42b778d48 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:25.279011 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:25.356968 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080052ff-9a73-4a43-bddd-5eb42b778d48 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:25.394616 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2661f7-bdb0-48a5-9716-2745cbab44e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:25.396234 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2661f7-bdb0-48a5-9716-2745cbab44e2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:25.396523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2661f7-bdb0-48a5-9716-2745cbab44e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:25.396805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2661f7-bdb0-48a5-9716-2745cbab44e2 None admin] PATH_INFO: `/v3/users/707ab2e590cb461da5107b8be6cd5e7f` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:25.414571 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2661f7-bdb0-48a5-9716-2745cbab44e2 None admin] RBAC: Authorizing `identity:get_user(user_id=707ab2e590cb461da5107b8be6cd5e7f)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:25.416260 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2661f7-bdb0-48a5-9716-2745cbab44e2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:25.417961 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 552/1114] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:42:25 2022] GET /identity/v3/users/707ab2e590cb461da5107b8be6cd5e7f => generated 286 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:25.424086 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ff56b-0aa1-4d08-b48f-6f9083cce115 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:25.537239 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ff56b-0aa1-4d08-b48f-6f9083cce115 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:25.557025 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:25.576601 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cf6ce-45e8-4d08-86eb-84d2a514e9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:25.577265 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cf6ce-45e8-4d08-86eb-84d2a514e9c0 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:25.577580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cf6ce-45e8-4d08-86eb-84d2a514e9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:25.577921 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cf6ce-45e8-4d08-86eb-84d2a514e9c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:25.653420 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cf6ce-45e8-4d08-86eb-84d2a514e9c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:25.654884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cf6ce-45e8-4d08-86eb-84d2a514e9c0 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:25.770801 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 563/1115] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:42:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:42:25.776537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2661f7-bdb0-48a5-9716-2745cbab44e2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:25.894276 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2661f7-bdb0-48a5-9716-2745cbab44e2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:25.895948 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:25.934202 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aae59b-1c42-46ab-ac19-590fcd4ddc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:25.934979 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae59b-1c42-46ab-ac19-590fcd4ddc7c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:25.935264 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae59b-1c42-46ab-ac19-590fcd4ddc7c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:25.935544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae59b-1c42-46ab-ac19-590fcd4ddc7c None admin] PATH_INFO: `/v3/projects/9df91c3f18fe48e8b7d677b664784b5e` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:25.936786 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aae59b-1c42-46ab-ac19-590fcd4ddc7c None admin] RBAC: Authorizing `identity:get_project(project_id=9df91c3f18fe48e8b7d677b664784b5e)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:25.938280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aae59b-1c42-46ab-ac19-590fcd4ddc7c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:25.940026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 553/1116] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:42:25 2022] GET /identity/v3/projects/9df91c3f18fe48e8b7d677b664784b5e => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:25.946300 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cf6ce-45e8-4d08-86eb-84d2a514e9c0 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:25.965898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:26.061658 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cf6ce-45e8-4d08-86eb-84d2a514e9c0 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:26.100229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa3b76-a3a6-426c-9f34-0a01da556920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:26.100888 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa3b76-a3a6-426c-9f34-0a01da556920 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:26.101196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa3b76-a3a6-426c-9f34-0a01da556920 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:26.101444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa3b76-a3a6-426c-9f34-0a01da556920 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:26.102283 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa3b76-a3a6-426c-9f34-0a01da556920 None admin] RBAC: Adding query filter params (role.id=97e1bde6953846e0b3e2204a9aa8868d, scope.project.id=9df91c3f18fe48e8b7d677b664784b5e, user.id=707ab2e590cb461da5107b8be6cd5e7f) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:26.102592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa3b76-a3a6-426c-9f34-0a01da556920 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:26.104069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa3b76-a3a6-426c-9f34-0a01da556920 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:26.110774 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 564/1117] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:42:25 2022] GET /identity/v3/role_assignments?user.id=707ab2e590cb461da5107b8be6cd5e7f&scope.project.id=9df91c3f18fe48e8b7d677b664784b5e&role.id=97e1bde6953846e0b3e2204a9aa8868d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:28.503028 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84095701-ae0d-46c5-ada5-3acac00c494a None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:28.503593 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84095701-ae0d-46c5-ada5-3acac00c494a None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:28.503593 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84095701-ae0d-46c5-ada5-3acac00c494a None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:28.505052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 554/1118] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:28.511999 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0b0fe-77ca-42e1-9e3b-df452e6ce66d None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:28.515310 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0b0fe-77ca-42e1-9e3b-df452e6ce66d None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:28.515631 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0b0fe-77ca-42e1-9e3b-df452e6ce66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:28.537938 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-2bc0b0fe-77ca-42e1-9e3b-df452e6ce66d None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:28.539184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-2bc0b0fe-77ca-42e1-9e3b-df452e6ce66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:28.620283 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 565/1119] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:28.643670 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84095701-ae0d-46c5-ada5-3acac00c494a None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:28.772839 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84095701-ae0d-46c5-ada5-3acac00c494a None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:28.816317 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945832d-089c-444b-bd3b-466563f506b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:28.817742 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945832d-089c-444b-bd3b-466563f506b4 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:28.818025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945832d-089c-444b-bd3b-466563f506b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:28.818293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945832d-089c-444b-bd3b-466563f506b4 None admin] PATH_INFO: `/v3/roles/97e1bde6953846e0b3e2204a9aa8868d` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:28.820211 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945832d-089c-444b-bd3b-466563f506b4 None admin] RBAC: Authorizing `identity:get_role(role_id=97e1bde6953846e0b3e2204a9aa8868d)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:28.821779 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945832d-089c-444b-bd3b-466563f506b4 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:28.823416 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 555/1120] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:42:28 2022] GET /identity/v3/roles/97e1bde6953846e0b3e2204a9aa8868d => generated 223 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:28.830385 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0b0fe-77ca-42e1-9e3b-df452e6ce66d None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:28.851020 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:28.975161 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0b0fe-77ca-42e1-9e3b-df452e6ce66d None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:29.017304 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a79a7-701c-4e95-9283-9a1db6d0075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:29.018235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a79a7-701c-4e95-9283-9a1db6d0075d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:29.018518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a79a7-701c-4e95-9283-9a1db6d0075d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:29.018796 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a79a7-701c-4e95-9283-9a1db6d0075d None admin] PATH_INFO: `/v3/users/707ab2e590cb461da5107b8be6cd5e7f` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:29.020908 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a79a7-701c-4e95-9283-9a1db6d0075d None admin] RBAC: Authorizing `identity:get_user(user_id=707ab2e590cb461da5107b8be6cd5e7f)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:29.022603 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a79a7-701c-4e95-9283-9a1db6d0075d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:29.024624 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 566/1121] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:42:28 2022] GET /identity/v3/users/707ab2e590cb461da5107b8be6cd5e7f => generated 286 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:29.030890 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945832d-089c-444b-bd3b-466563f506b4 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:29.104207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:29.178598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945832d-089c-444b-bd3b-466563f506b4 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:29.222083 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff679939-2e4c-4135-a395-d8320a7d55cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:29.223044 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff679939-2e4c-4135-a395-d8320a7d55cb None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:29.223431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff679939-2e4c-4135-a395-d8320a7d55cb None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:29.223715 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff679939-2e4c-4135-a395-d8320a7d55cb None admin] PATH_INFO: `/v3/projects/9df91c3f18fe48e8b7d677b664784b5e` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:29.225202 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff679939-2e4c-4135-a395-d8320a7d55cb None admin] RBAC: Authorizing `identity:get_project(project_id=9df91c3f18fe48e8b7d677b664784b5e)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:29.226709 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff679939-2e4c-4135-a395-d8320a7d55cb None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:29.228620 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 556/1122] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:42:29 2022] GET /identity/v3/projects/9df91c3f18fe48e8b7d677b664784b5e => generated 311 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:29.234883 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a79a7-701c-4e95-9283-9a1db6d0075d None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:29.328902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:29.351513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a79a7-701c-4e95-9283-9a1db6d0075d None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:29.397428 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370a08a-734c-4d7f-a178-e9e3f4b071e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:29.398363 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370a08a-734c-4d7f-a178-e9e3f4b071e2 None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:29.398648 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370a08a-734c-4d7f-a178-e9e3f4b071e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:29.398921 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370a08a-734c-4d7f-a178-e9e3f4b071e2 None admin] PATH_INFO: `/v3/projects/9df91c3f18fe48e8b7d677b664784b5e/users/707ab2e590cb461da5107b8be6cd5e7f/roles/97e1bde6953846e0b3e2204a9aa8868d` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:29.401371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370a08a-734c-4d7f-a178-e9e3f4b071e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9df91c3f18fe48e8b7d677b664784b5e, user_id=707ab2e590cb461da5107b8be6cd5e7f, role_id=97e1bde6953846e0b3e2204a9aa8868d)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:29.402878 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370a08a-734c-4d7f-a178-e9e3f4b071e2 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:29.424740 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 567/1123] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:42:29 2022] PUT /identity/v3/projects/9df91c3f18fe48e8b7d677b664784b5e/users/707ab2e590cb461da5107b8be6cd5e7f/roles/97e1bde6953846e0b3e2204a9aa8868d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:42:31.635514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e572eb5-235c-4f24-83ff-7b5fcd47d3fe None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:31.636099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e572eb5-235c-4f24-83ff-7b5fcd47d3fe None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:31.636099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e572eb5-235c-4f24-83ff-7b5fcd47d3fe None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:31.637478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 557/1124] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:31.642906 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d683b-e855-4779-ae8e-23aa94181301 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:31.643342 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d683b-e855-4779-ae8e-23aa94181301 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:31.643441 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d683b-e855-4779-ae8e-23aa94181301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:31.661531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-e44d683b-e855-4779-ae8e-23aa94181301 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:31.662714 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-e44d683b-e855-4779-ae8e-23aa94181301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:31.730410 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 568/1125] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:31.754293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e572eb5-235c-4f24-83ff-7b5fcd47d3fe None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:31.855804 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e572eb5-235c-4f24-83ff-7b5fcd47d3fe None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:31.863155 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:31.889868 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dabbf-33e6-4cf7-bf94-1231a28ff47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:31.890650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dabbf-33e6-4cf7-bf94-1231a28ff47d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:31.890934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dabbf-33e6-4cf7-bf94-1231a28ff47d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:31.891214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dabbf-33e6-4cf7-bf94-1231a28ff47d None admin] PATH_INFO: `/v3/roles/97e1bde6953846e0b3e2204a9aa8868d` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:31.892738 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dabbf-33e6-4cf7-bf94-1231a28ff47d None admin] RBAC: Authorizing `identity:get_role(role_id=97e1bde6953846e0b3e2204a9aa8868d)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:31.894111 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dabbf-33e6-4cf7-bf94-1231a28ff47d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:31.896102 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 558/1126] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:42:31 2022] GET /identity/v3/roles/97e1bde6953846e0b3e2204a9aa8868d => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:31.902136 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d683b-e855-4779-ae8e-23aa94181301 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:31.969152 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:32.000687 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d683b-e855-4779-ae8e-23aa94181301 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:32.034652 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a2153-dad1-44e2-8c56-4725271d95ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:32.035664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a2153-dad1-44e2-8c56-4725271d95ca None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:32.035945 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a2153-dad1-44e2-8c56-4725271d95ca None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:32.036250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a2153-dad1-44e2-8c56-4725271d95ca None admin] PATH_INFO: `/v3/users/707ab2e590cb461da5107b8be6cd5e7f` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:32.037442 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a2153-dad1-44e2-8c56-4725271d95ca None admin] RBAC: Authorizing `identity:get_user(user_id=707ab2e590cb461da5107b8be6cd5e7f)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:32.038893 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a2153-dad1-44e2-8c56-4725271d95ca None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:32.040561 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 569/1127] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:42:31 2022] GET /identity/v3/users/707ab2e590cb461da5107b8be6cd5e7f => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:32.046366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dabbf-33e6-4cf7-bf94-1231a28ff47d None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:32.145966 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dabbf-33e6-4cf7-bf94-1231a28ff47d None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:32.183812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5623801-87a6-4207-ac32-acde79bead4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:32.184507 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5623801-87a6-4207-ac32-acde79bead4a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:32.184816 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5623801-87a6-4207-ac32-acde79bead4a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:32.185092 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5623801-87a6-4207-ac32-acde79bead4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:32.228929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:32.254462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5623801-87a6-4207-ac32-acde79bead4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:32.255997 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5623801-87a6-4207-ac32-acde79bead4a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:32.350968 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 559/1128] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:42:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:42:32.356921 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a2153-dad1-44e2-8c56-4725271d95ca None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:32.492599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a2153-dad1-44e2-8c56-4725271d95ca None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:32.527899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa01160-c62d-428d-bd34-332c0c921f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:32.528786 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa01160-c62d-428d-bd34-332c0c921f9d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:32.529069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa01160-c62d-428d-bd34-332c0c921f9d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:32.529344 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa01160-c62d-428d-bd34-332c0c921f9d None admin] PATH_INFO: `/v3/projects/9df91c3f18fe48e8b7d677b664784b5e` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:32.530518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa01160-c62d-428d-bd34-332c0c921f9d None admin] RBAC: Authorizing `identity:get_project(project_id=9df91c3f18fe48e8b7d677b664784b5e)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:32.531968 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa01160-c62d-428d-bd34-332c0c921f9d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:32.533706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 570/1129] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:42:32 2022] GET /identity/v3/projects/9df91c3f18fe48e8b7d677b664784b5e => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:32.540544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5623801-87a6-4207-ac32-acde79bead4a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:32.614604 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:32.642135 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5623801-87a6-4207-ac32-acde79bead4a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:32.676645 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718513f-b2ca-4eda-8e95-e3f827787038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:32.677347 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718513f-b2ca-4eda-8e95-e3f827787038 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:32.677632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718513f-b2ca-4eda-8e95-e3f827787038 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:32.677910 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718513f-b2ca-4eda-8e95-e3f827787038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:32.678747 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718513f-b2ca-4eda-8e95-e3f827787038 None admin] RBAC: Adding query filter params (role.id=97e1bde6953846e0b3e2204a9aa8868d, scope.project.id=9df91c3f18fe48e8b7d677b664784b5e, user.id=707ab2e590cb461da5107b8be6cd5e7f) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:32.679062 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718513f-b2ca-4eda-8e95-e3f827787038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:32.680526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718513f-b2ca-4eda-8e95-e3f827787038 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:32.686342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 560/1130] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:42:32 2022] GET /identity/v3/role_assignments?user.id=707ab2e590cb461da5107b8be6cd5e7f&scope.project.id=9df91c3f18fe48e8b7d677b664784b5e&role.id=97e1bde6953846e0b3e2204a9aa8868d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:34.932629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7ba68-c0e6-4f65-b888-4a47702d41ea None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:34.933196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7ba68-c0e6-4f65-b888-4a47702d41ea None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:34.933196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7ba68-c0e6-4f65-b888-4a47702d41ea None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:34.934531 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 571/1131] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:34.939701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4c4b7-ddad-4a78-bdc2-737fa46c904e None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:34.940106 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4c4b7-ddad-4a78-bdc2-737fa46c904e None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:34.940293 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4c4b7-ddad-4a78-bdc2-737fa46c904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:34.957955 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-5ba4c4b7-ddad-4a78-bdc2-737fa46c904e None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:34.959076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-5ba4c4b7-ddad-4a78-bdc2-737fa46c904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:35.025987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 561/1132] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:35.049816 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7ba68-c0e6-4f65-b888-4a47702d41ea None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:35.059061 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:35.171123 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7ba68-c0e6-4f65-b888-4a47702d41ea None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:35.208325 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a4b0b-e0b3-4e3e-bc00-1a024da6e35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:35.209035 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a4b0b-e0b3-4e3e-bc00-1a024da6e35a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:35.209318 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a4b0b-e0b3-4e3e-bc00-1a024da6e35a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:35.209591 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a4b0b-e0b3-4e3e-bc00-1a024da6e35a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:35.210762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a4b0b-e0b3-4e3e-bc00-1a024da6e35a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:35.212228 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a4b0b-e0b3-4e3e-bc00-1a024da6e35a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:35.213862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 572/1133] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:35.219627 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4c4b7-ddad-4a78-bdc2-737fa46c904e None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:35.284676 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:35.318258 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4c4b7-ddad-4a78-bdc2-737fa46c904e None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:35.351817 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de523d1e-b462-4c5d-9fdc-6acd39e4f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:35.352504 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de523d1e-b462-4c5d-9fdc-6acd39e4f747 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:35.352789 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de523d1e-b462-4c5d-9fdc-6acd39e4f747 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:35.353068 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de523d1e-b462-4c5d-9fdc-6acd39e4f747 None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:35.353791 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de523d1e-b462-4c5d-9fdc-6acd39e4f747 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:35.355218 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de523d1e-b462-4c5d-9fdc-6acd39e4f747 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:35.380324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 562/1134] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:42:35 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:42:37.652192 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38140526-c22f-4d8c-bf5a-6d4718f6061c None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:37.652768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38140526-c22f-4d8c-bf5a-6d4718f6061c None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:37.652768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38140526-c22f-4d8c-bf5a-6d4718f6061c None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:37.654117 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 573/1135] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:37.659239 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690bf99-61e1-4c64-931b-3a23cc7fe12c None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:37.660276 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690bf99-61e1-4c64-931b-3a23cc7fe12c None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:37.660487 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690bf99-61e1-4c64-931b-3a23cc7fe12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:37.677267 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-d690bf99-61e1-4c64-931b-3a23cc7fe12c None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:37.678448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-d690bf99-61e1-4c64-931b-3a23cc7fe12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:37.745459 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 563/1136] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:37.770292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38140526-c22f-4d8c-bf5a-6d4718f6061c None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:37.851161 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:37.877618 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38140526-c22f-4d8c-bf5a-6d4718f6061c None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:37.915783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ddca9-3219-49b6-9f61-891581dcf7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:37.916509 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ddca9-3219-49b6-9f61-891581dcf7dc None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:37.916791 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ddca9-3219-49b6-9f61-891581dcf7dc None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:37.917065 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ddca9-3219-49b6-9f61-891581dcf7dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:37.918318 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ddca9-3219-49b6-9f61-891581dcf7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:37.919800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ddca9-3219-49b6-9f61-891581dcf7dc None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:37.921532 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 574/1137] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:42:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:37.927760 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690bf99-61e1-4c64-931b-3a23cc7fe12c None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:37.980267 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:38.034123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690bf99-61e1-4c64-931b-3a23cc7fe12c None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:38.070411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b425d-4a9e-4905-a526-25a89b1fcb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:38.071101 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b425d-4a9e-4905-a526-25a89b1fcb59 None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:38.071389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b425d-4a9e-4905-a526-25a89b1fcb59 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:38.071671 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b425d-4a9e-4905-a526-25a89b1fcb59 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:38.072436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b425d-4a9e-4905-a526-25a89b1fcb59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:38.073894 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b425d-4a9e-4905-a526-25a89b1fcb59 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:38.096012 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 564/1138] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:42:37 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:42:40.388058 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f89ad-11a3-4c63-98cb-a5b631480df0 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:40.388656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f89ad-11a3-4c63-98cb-a5b631480df0 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:40.388656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f89ad-11a3-4c63-98cb-a5b631480df0 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:40.390017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 575/1139] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:40.396567 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cb5f1-6e24-4ad5-855b-8b8ea1f602b2 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:40.397409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cb5f1-6e24-4ad5-855b-8b8ea1f602b2 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:40.397409 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cb5f1-6e24-4ad5-855b-8b8ea1f602b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:40.414938 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-c44cb5f1-6e24-4ad5-855b-8b8ea1f602b2 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:40.416179 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-c44cb5f1-6e24-4ad5-855b-8b8ea1f602b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:40.488967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 565/1140] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:42:40.512522 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f89ad-11a3-4c63-98cb-a5b631480df0 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:40.617925 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f89ad-11a3-4c63-98cb-a5b631480df0 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:40.653718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52b7d7-e118-4910-a9f2-adf071f61684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:40.654432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52b7d7-e118-4910-a9f2-adf071f61684 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:40.654709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52b7d7-e118-4910-a9f2-adf071f61684 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:40.654978 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52b7d7-e118-4910-a9f2-adf071f61684 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:40.666109 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52b7d7-e118-4910-a9f2-adf071f61684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-3b52b7d7-e118-4910-a9f2-adf071f61684 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:42:40.673666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:40.675352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:40.676755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 576/1141] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:42:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:40.681778 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cb5f1-6e24-4ad5-855b-8b8ea1f602b2 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:40.722951 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:40.790154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cb5f1-6e24-4ad5-855b-8b8ea1f602b2 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:40.825812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7b205-895d-4689-a644-20de8a9cf799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:40.826558 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7b205-895d-4689-a644-20de8a9cf799 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:40.826836 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7b205-895d-4689-a644-20de8a9cf799 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:40.827203 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7b205-895d-4689-a644-20de8a9cf799 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:40.828168 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7b205-895d-4689-a644-20de8a9cf799 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:40.828481 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7b205-895d-4689-a644-20de8a9cf799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:40.830062 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7b205-895d-4689-a644-20de8a9cf799 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:40.839523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 566/1142] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:42:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:40.845363 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52b7d7-e118-4910-a9f2-adf071f61684 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:40.849143 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:40.954172 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52b7d7-e118-4910-a9f2-adf071f61684 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:40.989877 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de2f50-11a3-4d4e-a269-525ea93bd191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:40.990751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de2f50-11a3-4d4e-a269-525ea93bd191 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:40.991033 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de2f50-11a3-4d4e-a269-525ea93bd191 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:40.991309 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de2f50-11a3-4d4e-a269-525ea93bd191 None admin] PATH_INFO: `/v3/users/1594e9688f3248e99189d4b814cb95ba` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:41.005271 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de2f50-11a3-4d4e-a269-525ea93bd191 None admin] RBAC: Authorizing `identity:get_user(user_id=1594e9688f3248e99189d4b814cb95ba)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:41.006724 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de2f50-11a3-4d4e-a269-525ea93bd191 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:41.008435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 577/1143] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:42:40 2022] GET /identity/v3/users/1594e9688f3248e99189d4b814cb95ba => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:41.014244 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7b205-895d-4689-a644-20de8a9cf799 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:41.108240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:41.112242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7b205-895d-4689-a644-20de8a9cf799 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:41.145412 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3180c39-7267-4552-a483-9cef3e56661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:41.146044 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3180c39-7267-4552-a483-9cef3e56661f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:41.146325 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3180c39-7267-4552-a483-9cef3e56661f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:41.146601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3180c39-7267-4552-a483-9cef3e56661f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:41.212394 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3180c39-7267-4552-a483-9cef3e56661f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:41.213749 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3180c39-7267-4552-a483-9cef3e56661f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:41.306329 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:41.311341 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 567/1144] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:42:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:42:41.321949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de2f50-11a3-4d4e-a269-525ea93bd191 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:41.387350 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:41.431770 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de2f50-11a3-4d4e-a269-525ea93bd191 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:41.468709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19d889-44f2-4896-98c6-75df51dddf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:41.469492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19d889-44f2-4896-98c6-75df51dddf56 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:41.469872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19d889-44f2-4896-98c6-75df51dddf56 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:41.470204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19d889-44f2-4896-98c6-75df51dddf56 None admin] PATH_INFO: `/v3/projects/0a7ef4f3efa44cfdafbee7e236e0328a` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:41.472376 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19d889-44f2-4896-98c6-75df51dddf56 None admin] RBAC: Authorizing `identity:get_project(project_id=0a7ef4f3efa44cfdafbee7e236e0328a)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:41.474742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19d889-44f2-4896-98c6-75df51dddf56 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:41.475971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 578/1145] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:42:41 2022] GET /identity/v3/projects/0a7ef4f3efa44cfdafbee7e236e0328a => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:41.482928 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3180c39-7267-4552-a483-9cef3e56661f None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:41.579961 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3180c39-7267-4552-a483-9cef3e56661f None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:41.615580 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ee625-3a6a-4126-a466-9e12ae62660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:41.616255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ee625-3a6a-4126-a466-9e12ae62660a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:41.616541 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ee625-3a6a-4126-a466-9e12ae62660a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:41.616816 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ee625-3a6a-4126-a466-9e12ae62660a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:41.617656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ee625-3a6a-4126-a466-9e12ae62660a None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=0a7ef4f3efa44cfdafbee7e236e0328a, user.id=1594e9688f3248e99189d4b814cb95ba) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:41.617969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ee625-3a6a-4126-a466-9e12ae62660a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:41.619406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ee625-3a6a-4126-a466-9e12ae62660a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:41.625029 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 568/1146] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:42:41 2022] GET /identity/v3/role_assignments?user.id=1594e9688f3248e99189d4b814cb95ba&scope.project.id=0a7ef4f3efa44cfdafbee7e236e0328a&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:43.872901 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd991d-afe2-47ee-83d3-49f3de1bf001 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:43.873465 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd991d-afe2-47ee-83d3-49f3de1bf001 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:43.873465 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd991d-afe2-47ee-83d3-49f3de1bf001 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:43.874827 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 579/1147] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:43.880281 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f7d25-95ee-4ddb-b0d5-770fd63406ab None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:43.880759 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f7d25-95ee-4ddb-b0d5-770fd63406ab None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:43.880853 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f7d25-95ee-4ddb-b0d5-770fd63406ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:43.898486 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-862f7d25-95ee-4ddb-b0d5-770fd63406ab None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:43.899725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-862f7d25-95ee-4ddb-b0d5-770fd63406ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:43.960396 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:43.971351 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 569/1148] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:43.995105 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd991d-afe2-47ee-83d3-49f3de1bf001 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:44.103595 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd991d-afe2-47ee-83d3-49f3de1bf001 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:44.139077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:44.152816 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc0a0-ff38-4b6f-b623-f0efbff0c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:44.153629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc0a0-ff38-4b6f-b623-f0efbff0c47b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:44.153911 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc0a0-ff38-4b6f-b623-f0efbff0c47b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:44.154185 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc0a0-ff38-4b6f-b623-f0efbff0c47b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:44.167745 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cc0a0-ff38-4b6f-b623-f0efbff0c47b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-8b2cc0a0-ff38-4b6f-b623-f0efbff0c47b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:42:44.178012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:44.179006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:44.180533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 580/1149] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:42:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:44.185964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f7d25-95ee-4ddb-b0d5-770fd63406ab None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:44.293044 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f7d25-95ee-4ddb-b0d5-770fd63406ab None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:44.327479 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09eda2-b50c-4974-9eb6-2693573c69a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:44.328176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09eda2-b50c-4974-9eb6-2693573c69a5 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:44.328465 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09eda2-b50c-4974-9eb6-2693573c69a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:44.328745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09eda2-b50c-4974-9eb6-2693573c69a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:44.329510 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09eda2-b50c-4974-9eb6-2693573c69a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:44.329822 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09eda2-b50c-4974-9eb6-2693573c69a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:44.331608 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09eda2-b50c-4974-9eb6-2693573c69a5 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:44.340046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 570/1150] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:44.346477 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc0a0-ff38-4b6f-b623-f0efbff0c47b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:44.447211 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc0a0-ff38-4b6f-b623-f0efbff0c47b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:44.482901 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef849fa-5076-4726-b847-915490f15af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:44.483768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef849fa-5076-4726-b847-915490f15af3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:44.484050 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef849fa-5076-4726-b847-915490f15af3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:44.484352 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef849fa-5076-4726-b847-915490f15af3 None admin] PATH_INFO: `/v3/users/1594e9688f3248e99189d4b814cb95ba` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:44.485554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef849fa-5076-4726-b847-915490f15af3 None admin] RBAC: Authorizing `identity:get_user(user_id=1594e9688f3248e99189d4b814cb95ba)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:44.487001 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef849fa-5076-4726-b847-915490f15af3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:44.488896 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 581/1151] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:42:44 2022] GET /identity/v3/users/1594e9688f3248e99189d4b814cb95ba => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:44.494640 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09eda2-b50c-4974-9eb6-2693573c69a5 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:44.566312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:44.631055 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09eda2-b50c-4974-9eb6-2693573c69a5 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:44.666842 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799ea7d-866e-4c58-8c59-766f164260ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:44.667699 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799ea7d-866e-4c58-8c59-766f164260ef None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:44.667978 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799ea7d-866e-4c58-8c59-766f164260ef None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:44.668283 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799ea7d-866e-4c58-8c59-766f164260ef None admin] PATH_INFO: `/v3/projects/0a7ef4f3efa44cfdafbee7e236e0328a` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:44.669469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799ea7d-866e-4c58-8c59-766f164260ef None admin] RBAC: Authorizing `identity:get_project(project_id=0a7ef4f3efa44cfdafbee7e236e0328a)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:44.670901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799ea7d-866e-4c58-8c59-766f164260ef None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:44.672643 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 571/1152] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:42:44 2022] GET /identity/v3/projects/0a7ef4f3efa44cfdafbee7e236e0328a => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:44.679382 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef849fa-5076-4726-b847-915490f15af3 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:44.738690 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:44.785078 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef849fa-5076-4726-b847-915490f15af3 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:44.820450 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df702fd-5621-4bee-a3a9-1b41c52ad33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:44.821247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df702fd-5621-4bee-a3a9-1b41c52ad33a None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:44.821526 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df702fd-5621-4bee-a3a9-1b41c52ad33a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:44.821800 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df702fd-5621-4bee-a3a9-1b41c52ad33a None admin] PATH_INFO: `/v3/projects/0a7ef4f3efa44cfdafbee7e236e0328a/users/1594e9688f3248e99189d4b814cb95ba/roles/109ea861e27e4d75bec3ac9c5f81096e` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:44.823833 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df702fd-5621-4bee-a3a9-1b41c52ad33a None admin] RBAC: Authorizing `identity:create_grant(project_id=0a7ef4f3efa44cfdafbee7e236e0328a, user_id=1594e9688f3248e99189d4b814cb95ba, role_id=109ea861e27e4d75bec3ac9c5f81096e)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:44.825306 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df702fd-5621-4bee-a3a9-1b41c52ad33a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:44.840650 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 582/1153] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:42:44 2022] PUT /identity/v3/projects/0a7ef4f3efa44cfdafbee7e236e0328a/users/1594e9688f3248e99189d4b814cb95ba/roles/109ea861e27e4d75bec3ac9c5f81096e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:42:47.160906 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08350682-a082-4d82-9c09-7e6992f359e4 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.161469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08350682-a082-4d82-9c09-7e6992f359e4 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.161469 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08350682-a082-4d82-9c09-7e6992f359e4 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.162805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 572/1154] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:47.168327 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1795b1c-9f61-4ed2-974b-c264724674eb None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.168798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1795b1c-9f61-4ed2-974b-c264724674eb None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.168891 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1795b1c-9f61-4ed2-974b-c264724674eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.185902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-c1795b1c-9f61-4ed2-974b-c264724674eb None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:47.187132 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-c1795b1c-9f61-4ed2-974b-c264724674eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:47.255960 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 583/1155] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:47.279919 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08350682-a082-4d82-9c09-7e6992f359e4 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:47.384751 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08350682-a082-4d82-9c09-7e6992f359e4 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:47.407061 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:47.418675 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5871d-c6f4-4431-a339-4c2532dba199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:47.419408 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5871d-c6f4-4431-a339-4c2532dba199 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.419688 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5871d-c6f4-4431-a339-4c2532dba199 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.419962 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5871d-c6f4-4431-a339-4c2532dba199 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.430977 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5871d-c6f4-4431-a339-4c2532dba199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-e2a5871d-c6f4-4431-a339-4c2532dba199 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:42:47.438611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:47.440917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:42:47.442818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 573/1156] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:42:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:47.447525 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1795b1c-9f61-4ed2-974b-c264724674eb None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:47.505024 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:47.562729 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1795b1c-9f61-4ed2-974b-c264724674eb None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:47.598274 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d52d68-553c-4844-9353-ed329b62006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:47.598941 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52d68-553c-4844-9353-ed329b62006a None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.599223 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52d68-553c-4844-9353-ed329b62006a None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.599497 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52d68-553c-4844-9353-ed329b62006a None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.600323 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d52d68-553c-4844-9353-ed329b62006a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:47.600580 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d52d68-553c-4844-9353-ed329b62006a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:47.601954 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d52d68-553c-4844-9353-ed329b62006a None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:47.610005 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 584/1157] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:42:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:47.616569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5871d-c6f4-4431-a339-4c2532dba199 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:47.715513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5871d-c6f4-4431-a339-4c2532dba199 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:47.751173 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c8178-3cd7-48d6-818b-b1b4a9ac8513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:47.752038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c8178-3cd7-48d6-818b-b1b4a9ac8513 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.752862 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c8178-3cd7-48d6-818b-b1b4a9ac8513 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.753161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c8178-3cd7-48d6-818b-b1b4a9ac8513 None admin] PATH_INFO: `/v3/users/1594e9688f3248e99189d4b814cb95ba` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.754323 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c8178-3cd7-48d6-818b-b1b4a9ac8513 None admin] RBAC: Authorizing `identity:get_user(user_id=1594e9688f3248e99189d4b814cb95ba)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:47.755752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c8178-3cd7-48d6-818b-b1b4a9ac8513 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:47.757407 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 574/1158] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:42:47 2022] GET /identity/v3/users/1594e9688f3248e99189d4b814cb95ba => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:47.763273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d52d68-553c-4844-9353-ed329b62006a None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:47.865045 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d52d68-553c-4844-9353-ed329b62006a None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:47.873766 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:47.899398 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fac91-0234-46e2-884d-c35570131577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:47.901175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fac91-0234-46e2-884d-c35570131577 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.901471 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fac91-0234-46e2-884d-c35570131577 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.901750 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fac91-0234-46e2-884d-c35570131577 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.972623 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fac91-0234-46e2-884d-c35570131577 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:47.973999 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fac91-0234-46e2-884d-c35570131577 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:48.070899 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 585/1159] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:42:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:42:48.076893 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c8178-3cd7-48d6-818b-b1b4a9ac8513 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:48.125770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:48.176588 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c8178-3cd7-48d6-818b-b1b4a9ac8513 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:48.211066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e680e1d-e87c-4c0a-8762-d49a6f61ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:48.211923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e680e1d-e87c-4c0a-8762-d49a6f61ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:48.212230 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e680e1d-e87c-4c0a-8762-d49a6f61ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:48.212502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e680e1d-e87c-4c0a-8762-d49a6f61ffc6 None admin] PATH_INFO: `/v3/projects/0a7ef4f3efa44cfdafbee7e236e0328a` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:48.213676 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e680e1d-e87c-4c0a-8762-d49a6f61ffc6 None admin] RBAC: Authorizing `identity:get_project(project_id=0a7ef4f3efa44cfdafbee7e236e0328a)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:48.215098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e680e1d-e87c-4c0a-8762-d49a6f61ffc6 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:48.216821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 575/1160] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:42:48 2022] GET /identity/v3/projects/0a7ef4f3efa44cfdafbee7e236e0328a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:48.224393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fac91-0234-46e2-884d-c35570131577 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:48.234731 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:48.328900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fac91-0234-46e2-884d-c35570131577 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:48.365016 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e2d77-dc36-4dae-84c6-f4d686e1e394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:48.365674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e2d77-dc36-4dae-84c6-f4d686e1e394 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:48.365952 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e2d77-dc36-4dae-84c6-f4d686e1e394 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:48.366224 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e2d77-dc36-4dae-84c6-f4d686e1e394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:48.367054 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e2d77-dc36-4dae-84c6-f4d686e1e394 None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=0a7ef4f3efa44cfdafbee7e236e0328a, user.id=1594e9688f3248e99189d4b814cb95ba) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:48.367365 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e2d77-dc36-4dae-84c6-f4d686e1e394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:48.368828 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e2d77-dc36-4dae-84c6-f4d686e1e394 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:48.374691 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 586/1161] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:42:48 2022] GET /identity/v3/role_assignments?user.id=1594e9688f3248e99189d4b814cb95ba&scope.project.id=0a7ef4f3efa44cfdafbee7e236e0328a&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:42:50.580096 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a5c15-81be-4b99-aeba-3cec4797fc0b None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:50.580824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a5c15-81be-4b99-aeba-3cec4797fc0b None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:50.580824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a5c15-81be-4b99-aeba-3cec4797fc0b None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:50.582117 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 576/1162] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:50.587869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e5d0d-5840-4360-aaf0-b0f17426a72b None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:50.588324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e5d0d-5840-4360-aaf0-b0f17426a72b None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:50.588471 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e5d0d-5840-4360-aaf0-b0f17426a72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:50.605335 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-6a8e5d0d-5840-4360-aaf0-b0f17426a72b None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:50.606535 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-6a8e5d0d-5840-4360-aaf0-b0f17426a72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:50.683913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 587/1163] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:50.706875 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a5c15-81be-4b99-aeba-3cec4797fc0b None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:50.813209 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a5c15-81be-4b99-aeba-3cec4797fc0b None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:50.830622 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:50.848290 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb5901-2175-4e79-80ff-754ffc2b4021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:50.848940 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb5901-2175-4e79-80ff-754ffc2b4021 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:50.849219 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb5901-2175-4e79-80ff-754ffc2b4021 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:50.849494 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb5901-2175-4e79-80ff-754ffc2b4021 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:50.922138 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb5901-2175-4e79-80ff-754ffc2b4021 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:50.923576 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb5901-2175-4e79-80ff-754ffc2b4021 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:51.025987 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 577/1164] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:42:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:42:51.032045 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e5d0d-5840-4360-aaf0-b0f17426a72b None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:51.034925 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:51.136400 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e5d0d-5840-4360-aaf0-b0f17426a72b None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:51.176145 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f79697-d9e1-4d7a-921e-5a5e7463ed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:51.177036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f79697-d9e1-4d7a-921e-5a5e7463ed1d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:51.177323 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f79697-d9e1-4d7a-921e-5a5e7463ed1d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:51.177602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f79697-d9e1-4d7a-921e-5a5e7463ed1d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:51.184695 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f79697-d9e1-4d7a-921e-5a5e7463ed1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:51.186165 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f79697-d9e1-4d7a-921e-5a5e7463ed1d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-d9f79697-d9e1-4d7a-921e-5a5e7463ed1d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:42:51.200470 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:42:51.201728 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:42:51.202880 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 588/1165] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 13:42:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:42:51.208445 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb5901-2175-4e79-80ff-754ffc2b4021 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:51.227300 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:51.313860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb5901-2175-4e79-80ff-754ffc2b4021 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:51.349185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8077384-67f5-40db-89ee-5bce65f9193f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:51.349846 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8077384-67f5-40db-89ee-5bce65f9193f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:51.350129 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8077384-67f5-40db-89ee-5bce65f9193f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:51.350404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8077384-67f5-40db-89ee-5bce65f9193f None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:51.351134 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8077384-67f5-40db-89ee-5bce65f9193f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:42:51.351443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8077384-67f5-40db-89ee-5bce65f9193f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:51.352836 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8077384-67f5-40db-89ee-5bce65f9193f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:51.360222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 578/1166] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 13:42:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:53.597734 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5be4a-4c1a-4d9b-ad59-7dfcdb5d95f2 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:53.598276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5be4a-4c1a-4d9b-ad59-7dfcdb5d95f2 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:53.598276 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5be4a-4c1a-4d9b-ad59-7dfcdb5d95f2 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:53.599659 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 589/1167] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:53.605141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad577b90-7589-4132-b4b8-f18aa666e764 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:53.605605 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad577b90-7589-4132-b4b8-f18aa666e764 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:53.605721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad577b90-7589-4132-b4b8-f18aa666e764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:53.622581 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-ad577b90-7589-4132-b4b8-f18aa666e764 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:53.623789 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-ad577b90-7589-4132-b4b8-f18aa666e764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:53.694025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 579/1168] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:53.718237 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5be4a-4c1a-4d9b-ad59-7dfcdb5d95f2 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:53.782808 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:53.823514 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5be4a-4c1a-4d9b-ad59-7dfcdb5d95f2 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:53.858553 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d93cb5-049a-4c3d-a86d-20b1c5cff634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:53.859146 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d93cb5-049a-4c3d-a86d-20b1c5cff634 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:53.859432 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d93cb5-049a-4c3d-a86d-20b1c5cff634 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:53.859710 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d93cb5-049a-4c3d-a86d-20b1c5cff634 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:53.860494 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d93cb5-049a-4c3d-a86d-20b1c5cff634 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:53.862036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d93cb5-049a-4c3d-a86d-20b1c5cff634 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:53.876191 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 590/1169] 10.222.0.24 () {60 vars in 1138 bytes} [Wed May 25 13:42:53 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:42:56.141321 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e9877-9f29-42e3-950d-6bb9df746b28 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:56.141842 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e9877-9f29-42e3-950d-6bb9df746b28 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:56.141957 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e9877-9f29-42e3-950d-6bb9df746b28 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:56.143783 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 580/1170] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:56.149552 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaadb8f-1f98-4857-b7b3-47ff3d81412a None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:56.149988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaadb8f-1f98-4857-b7b3-47ff3d81412a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:56.150104 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaadb8f-1f98-4857-b7b3-47ff3d81412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:56.166657 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-9aaadb8f-1f98-4857-b7b3-47ff3d81412a None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:56.167840 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-9aaadb8f-1f98-4857-b7b3-47ff3d81412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:56.234447 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 591/1171] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:56.257813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e9877-9f29-42e3-950d-6bb9df746b28 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:56.273141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:56.359581 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e9877-9f29-42e3-950d-6bb9df746b28 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:56.391915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d5be8-4e42-44d4-adb2-ea8d4c774ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:56.393258 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d5be8-4e42-44d4-adb2-ea8d4c774ac3 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:56.393541 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d5be8-4e42-44d4-adb2-ea8d4c774ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:56.393820 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d5be8-4e42-44d4-adb2-ea8d4c774ac3 None admin] PATH_INFO: `/v3/domains/72a6cf44e78041ac943618715d3afe92` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:56.404014 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d5be8-4e42-44d4-adb2-ea8d4c774ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=72a6cf44e78041ac943618715d3afe92)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:56.405488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d5be8-4e42-44d4-adb2-ea8d4c774ac3 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:56.407094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 581/1172] 10.222.0.24 () {56 vars in 1183 bytes} [Wed May 25 13:42:56 2022] GET /identity/v3/domains/72a6cf44e78041ac943618715d3afe92 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:56.413743 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaadb8f-1f98-4857-b7b3-47ff3d81412a None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:56.465243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:56.511843 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaadb8f-1f98-4857-b7b3-47ff3d81412a None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:56.545332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed444a-080f-42bd-9d47-0b5d70de6643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:56.545984 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed444a-080f-42bd-9d47-0b5d70de6643 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:56.546264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed444a-080f-42bd-9d47-0b5d70de6643 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:56.546537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed444a-080f-42bd-9d47-0b5d70de6643 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:56.547247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed444a-080f-42bd-9d47-0b5d70de6643 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:56.548831 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed444a-080f-42bd-9d47-0b5d70de6643 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:56.573678 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 592/1173] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:42:56 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:42:58.849443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cf57b-dce2-43b5-80be-48d4f8b287db None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:58.849976 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cf57b-dce2-43b5-80be-48d4f8b287db None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:58.849976 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cf57b-dce2-43b5-80be-48d4f8b287db None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:58.851355 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 582/1174] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:58.856953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dfd95-7bd0-4dd3-9b40-5f4872ba54be None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:58.857396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dfd95-7bd0-4dd3-9b40-5f4872ba54be None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:58.857502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dfd95-7bd0-4dd3-9b40-5f4872ba54be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:58.875065 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-961dfd95-7bd0-4dd3-9b40-5f4872ba54be None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:58.876288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-961dfd95-7bd0-4dd3-9b40-5f4872ba54be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:58.946748 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 593/1175] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:42:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:42:58.982766 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cf57b-dce2-43b5-80be-48d4f8b287db None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:59.060455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:59.092346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cf57b-dce2-43b5-80be-48d4f8b287db None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:59.126680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603a090-c3fd-4e84-8aea-0c2eab9b2b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:59.127541 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603a090-c3fd-4e84-8aea-0c2eab9b2b9f None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:59.127817 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603a090-c3fd-4e84-8aea-0c2eab9b2b9f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:59.128088 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603a090-c3fd-4e84-8aea-0c2eab9b2b9f None admin] PATH_INFO: `/v3/domains/72a6cf44e78041ac943618715d3afe92` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:59.129318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603a090-c3fd-4e84-8aea-0c2eab9b2b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=72a6cf44e78041ac943618715d3afe92)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:59.130769 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603a090-c3fd-4e84-8aea-0c2eab9b2b9f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:59.132440 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 583/1176] 10.222.0.24 () {56 vars in 1183 bytes} [Wed May 25 13:42:58 2022] GET /identity/v3/domains/72a6cf44e78041ac943618715d3afe92 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:42:59.138211 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dfd95-7bd0-4dd3-9b40-5f4872ba54be None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:59.172778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:59.245072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dfd95-7bd0-4dd3-9b40-5f4872ba54be None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:59.284533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce420fc8-ecb5-46be-bd03-5ff28ac3a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:59.285539 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce420fc8-ecb5-46be-bd03-5ff28ac3a631 None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:59.285824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce420fc8-ecb5-46be-bd03-5ff28ac3a631 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:59.286101 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce420fc8-ecb5-46be-bd03-5ff28ac3a631 None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:59.286832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce420fc8-ecb5-46be-bd03-5ff28ac3a631 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:59.288414 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce420fc8-ecb5-46be-bd03-5ff28ac3a631 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:59.314675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 594/1177] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:42:59 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:43:01.575227 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09643987-05b6-42f2-834a-4c3ca37a6dd7 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:01.575820 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09643987-05b6-42f2-834a-4c3ca37a6dd7 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:01.575820 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09643987-05b6-42f2-834a-4c3ca37a6dd7 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:01.577190 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 584/1178] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:01.583058 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e4f64-5f0f-4c62-91d8-f17f3beca36e None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:01.583506 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e4f64-5f0f-4c62-91d8-f17f3beca36e None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:01.583609 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e4f64-5f0f-4c62-91d8-f17f3beca36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:01.600865 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-b31e4f64-5f0f-4c62-91d8-f17f3beca36e None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:01.602062 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-b31e4f64-5f0f-4c62-91d8-f17f3beca36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:01.671013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 595/1179] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:43:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:43:01.693998 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09643987-05b6-42f2-834a-4c3ca37a6dd7 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:01.796085 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09643987-05b6-42f2-834a-4c3ca37a6dd7 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:01.828743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4d291-30c6-40bb-b2dd-e3efab1f5977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:01.830026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d291-30c6-40bb-b2dd-e3efab1f5977 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:01.830302 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d291-30c6-40bb-b2dd-e3efab1f5977 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:01.830669 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d291-30c6-40bb-b2dd-e3efab1f5977 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:01.839510 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:01.843929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4d291-30c6-40bb-b2dd-e3efab1f5977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-64e4d291-30c6-40bb-b2dd-e3efab1f5977 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:43:01.852585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:43:01.853873 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:43:01.855159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 585/1180] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:43:01.860151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e4f64-5f0f-4c62-91d8-f17f3beca36e None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:01.882045 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:01.963182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e4f64-5f0f-4c62-91d8-f17f3beca36e None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:01.999462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43881448-180c-4651-bc8c-2fb5f5b6fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:02.000158 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43881448-180c-4651-bc8c-2fb5f5b6fb0c None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:02.000443 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43881448-180c-4651-bc8c-2fb5f5b6fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:02.000718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43881448-180c-4651-bc8c-2fb5f5b6fb0c None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:02.002297 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43881448-180c-4651-bc8c-2fb5f5b6fb0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:43:02.002613 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43881448-180c-4651-bc8c-2fb5f5b6fb0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:02.004019 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43881448-180c-4651-bc8c-2fb5f5b6fb0c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:02.013008 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 596/1181] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:43:02.021368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4d291-30c6-40bb-b2dd-e3efab1f5977 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:02.118534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4d291-30c6-40bb-b2dd-e3efab1f5977 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:02.151958 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460df3de-6d16-47b6-a088-d6ca796b8c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:02.152856 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460df3de-6d16-47b6-a088-d6ca796b8c69 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:02.153138 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460df3de-6d16-47b6-a088-d6ca796b8c69 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:02.153410 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460df3de-6d16-47b6-a088-d6ca796b8c69 None admin] PATH_INFO: `/v3/users/01ab831c7cc54aa29a89704fd2cfcb15` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:02.166424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460df3de-6d16-47b6-a088-d6ca796b8c69 None admin] RBAC: Authorizing `identity:get_user(user_id=01ab831c7cc54aa29a89704fd2cfcb15)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:02.167866 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460df3de-6d16-47b6-a088-d6ca796b8c69 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:02.169565 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 586/1182] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:43:02 2022] GET /identity/v3/users/01ab831c7cc54aa29a89704fd2cfcb15 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:43:02.175938 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43881448-180c-4651-bc8c-2fb5f5b6fb0c None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:02.259082 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:02.277229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43881448-180c-4651-bc8c-2fb5f5b6fb0c None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:02.317046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c41975-835f-4724-bb61-6612e4fe073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:02.317710 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c41975-835f-4724-bb61-6612e4fe073b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:02.317993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c41975-835f-4724-bb61-6612e4fe073b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:02.318321 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c41975-835f-4724-bb61-6612e4fe073b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:02.390063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c41975-835f-4724-bb61-6612e4fe073b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:02.391498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c41975-835f-4724-bb61-6612e4fe073b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:02.469736 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:02.489150 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 597/1183] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:43:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:43:02.495186 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460df3de-6d16-47b6-a088-d6ca796b8c69 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:02.558665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:02.609497 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460df3de-6d16-47b6-a088-d6ca796b8c69 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:02.645141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015639a-1f20-4178-b0c0-7b83fd96244c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:02.645916 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015639a-1f20-4178-b0c0-7b83fd96244c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:02.646199 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015639a-1f20-4178-b0c0-7b83fd96244c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:02.646476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015639a-1f20-4178-b0c0-7b83fd96244c None admin] PATH_INFO: `/v3/projects/a7c1674cd2be40d092920035e6a153a7` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:02.647643 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015639a-1f20-4178-b0c0-7b83fd96244c None admin] RBAC: Authorizing `identity:get_project(project_id=a7c1674cd2be40d092920035e6a153a7)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:02.649108 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015639a-1f20-4178-b0c0-7b83fd96244c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:02.650800 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 587/1184] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:43:02 2022] GET /identity/v3/projects/a7c1674cd2be40d092920035e6a153a7 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:43:02.656926 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c41975-835f-4724-bb61-6612e4fe073b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:02.770827 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c41975-835f-4724-bb61-6612e4fe073b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:02.806584 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b45548-2636-4730-8f26-43db54c8eff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:02.807249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45548-2636-4730-8f26-43db54c8eff1 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:02.807535 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45548-2636-4730-8f26-43db54c8eff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:02.807812 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45548-2636-4730-8f26-43db54c8eff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:02.808696 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b45548-2636-4730-8f26-43db54c8eff1 None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=a7c1674cd2be40d092920035e6a153a7, user.id=01ab831c7cc54aa29a89704fd2cfcb15) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:43:02.809003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b45548-2636-4730-8f26-43db54c8eff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:02.810697 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b45548-2636-4730-8f26-43db54c8eff1 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:02.817058 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 598/1185] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:43:02 2022] GET /identity/v3/role_assignments?user.id=01ab831c7cc54aa29a89704fd2cfcb15&scope.project.id=a7c1674cd2be40d092920035e6a153a7&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:43:05.075188 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b87ec-ddd0-49d0-aff0-a8de6835bc2a None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.075696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b87ec-ddd0-49d0-aff0-a8de6835bc2a None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.075696 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b87ec-ddd0-49d0-aff0-a8de6835bc2a None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.077048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 588/1186] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:05.082917 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ac5fe-ef7b-411e-adce-f61a94b93230 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.083370 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ac5fe-ef7b-411e-adce-f61a94b93230 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.083471 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ac5fe-ef7b-411e-adce-f61a94b93230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.100251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-d24ac5fe-ef7b-411e-adce-f61a94b93230 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:05.101464 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-d24ac5fe-ef7b-411e-adce-f61a94b93230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:05.144301 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:05.168542 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 599/1187] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:43:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:43:05.192008 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b87ec-ddd0-49d0-aff0-a8de6835bc2a None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:05.289975 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b87ec-ddd0-49d0-aff0-a8de6835bc2a None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:05.315736 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:05.324958 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e8233-888c-4185-933d-009ceaf024c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:05.325792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e8233-888c-4185-933d-009ceaf024c2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.326028 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e8233-888c-4185-933d-009ceaf024c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.326304 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e8233-888c-4185-933d-009ceaf024c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.336232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e8233-888c-4185-933d-009ceaf024c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-2b0e8233-888c-4185-933d-009ceaf024c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:43:05.343727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:43:05.345157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:43:05.346157 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 589/1188] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:43:05.351540 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ac5fe-ef7b-411e-adce-f61a94b93230 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:05.462655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ac5fe-ef7b-411e-adce-f61a94b93230 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:05.499659 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd1d8b-6b36-4fbc-80c4-2ed7ceaf5ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:05.500360 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd1d8b-6b36-4fbc-80c4-2ed7ceaf5ac2 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.500645 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd1d8b-6b36-4fbc-80c4-2ed7ceaf5ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.501494 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd1d8b-6b36-4fbc-80c4-2ed7ceaf5ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.502252 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd1d8b-6b36-4fbc-80c4-2ed7ceaf5ac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:43:05.502561 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd1d8b-6b36-4fbc-80c4-2ed7ceaf5ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:05.503960 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd1d8b-6b36-4fbc-80c4-2ed7ceaf5ac2 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:05.514174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 600/1189] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:43:05.520523 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e8233-888c-4185-933d-009ceaf024c2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:05.639111 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e8233-888c-4185-933d-009ceaf024c2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:05.674496 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b08da-8c47-4697-886b-aaed529f6506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:05.675359 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b08da-8c47-4697-886b-aaed529f6506 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.675642 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b08da-8c47-4697-886b-aaed529f6506 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.675920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b08da-8c47-4697-886b-aaed529f6506 None admin] PATH_INFO: `/v3/users/01ab831c7cc54aa29a89704fd2cfcb15` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.677149 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b08da-8c47-4697-886b-aaed529f6506 None admin] RBAC: Authorizing `identity:get_user(user_id=01ab831c7cc54aa29a89704fd2cfcb15)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:05.678586 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b08da-8c47-4697-886b-aaed529f6506 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:05.680234 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 590/1190] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:43:05 2022] GET /identity/v3/users/01ab831c7cc54aa29a89704fd2cfcb15 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:43:05.686257 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd1d8b-6b36-4fbc-80c4-2ed7ceaf5ac2 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:05.728055 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:05.801380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd1d8b-6b36-4fbc-80c4-2ed7ceaf5ac2 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:05.835372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fb2e3-4dc6-44a5-86aa-f3ce9b204194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:05.836247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fb2e3-4dc6-44a5-86aa-f3ce9b204194 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.836529 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fb2e3-4dc6-44a5-86aa-f3ce9b204194 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.836803 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fb2e3-4dc6-44a5-86aa-f3ce9b204194 None admin] PATH_INFO: `/v3/projects/a7c1674cd2be40d092920035e6a153a7` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.837968 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fb2e3-4dc6-44a5-86aa-f3ce9b204194 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c1674cd2be40d092920035e6a153a7)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:05.839416 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fb2e3-4dc6-44a5-86aa-f3ce9b204194 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:05.841131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 601/1191] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:43:05 2022] GET /identity/v3/projects/a7c1674cd2be40d092920035e6a153a7 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:43:05.848021 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b08da-8c47-4697-886b-aaed529f6506 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:05.903625 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:05.947841 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b08da-8c47-4697-886b-aaed529f6506 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:05.982167 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99dfb1-602a-4588-a786-ffc69873dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:05.983045 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99dfb1-602a-4588-a786-ffc69873dfe2 None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.983325 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99dfb1-602a-4588-a786-ffc69873dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.983596 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99dfb1-602a-4588-a786-ffc69873dfe2 None admin] PATH_INFO: `/v3/projects/a7c1674cd2be40d092920035e6a153a7/users/01ab831c7cc54aa29a89704fd2cfcb15/roles/109ea861e27e4d75bec3ac9c5f81096e` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.985768 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99dfb1-602a-4588-a786-ffc69873dfe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7c1674cd2be40d092920035e6a153a7, user_id=01ab831c7cc54aa29a89704fd2cfcb15, role_id=109ea861e27e4d75bec3ac9c5f81096e)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:05.987185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99dfb1-602a-4588-a786-ffc69873dfe2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:06.000028 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 591/1192] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:43:05 2022] PUT /identity/v3/projects/a7c1674cd2be40d092920035e6a153a7/users/01ab831c7cc54aa29a89704fd2cfcb15/roles/109ea861e27e4d75bec3ac9c5f81096e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:43:08.259890 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82331165-d4b0-4406-b2f0-6d27d6dd7c10 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:08.260492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82331165-d4b0-4406-b2f0-6d27d6dd7c10 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:08.260492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82331165-d4b0-4406-b2f0-6d27d6dd7c10 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:08.261867 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 602/1193] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:08.267705 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806478d-b7dc-4782-8274-875c55a63094 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:08.268379 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806478d-b7dc-4782-8274-875c55a63094 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:08.268510 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806478d-b7dc-4782-8274-875c55a63094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:08.285744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-8806478d-b7dc-4782-8274-875c55a63094 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:08.286949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-8806478d-b7dc-4782-8274-875c55a63094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:08.353368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 592/1194] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:43:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:43:08.377844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82331165-d4b0-4406-b2f0-6d27d6dd7c10 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:08.489173 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82331165-d4b0-4406-b2f0-6d27d6dd7c10 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:08.496763 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:08.524490 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd597c-0799-4ce1-be3b-d5abe9cea402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:08.525202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd597c-0799-4ce1-be3b-d5abe9cea402 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:08.525481 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd597c-0799-4ce1-be3b-d5abe9cea402 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:08.525751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd597c-0799-4ce1-be3b-d5abe9cea402 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:08.536528 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd597c-0799-4ce1-be3b-d5abe9cea402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-3edd597c-0799-4ce1-be3b-d5abe9cea402 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:43:08.544018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:43:08.545182 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:43:08.546249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 603/1195] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:43:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:43:08.552282 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806478d-b7dc-4782-8274-875c55a63094 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:08.596859 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:08.652751 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806478d-b7dc-4782-8274-875c55a63094 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:08.688999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919efa6-8f8d-4cf8-a01b-557db43f074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:08.689668 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919efa6-8f8d-4cf8-a01b-557db43f074a None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:08.689954 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919efa6-8f8d-4cf8-a01b-557db43f074a None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:08.690230 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919efa6-8f8d-4cf8-a01b-557db43f074a None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:08.690979 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919efa6-8f8d-4cf8-a01b-557db43f074a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:43:08.691288 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919efa6-8f8d-4cf8-a01b-557db43f074a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:08.692680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919efa6-8f8d-4cf8-a01b-557db43f074a None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:08.700762 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 593/1196] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:43:08.707351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd597c-0799-4ce1-be3b-d5abe9cea402 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:08.806092 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd597c-0799-4ce1-be3b-d5abe9cea402 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:08.840544 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b2314-95c7-4a8f-b3c9-8ab3b1e5ea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:08.841402 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2314-95c7-4a8f-b3c9-8ab3b1e5ea0f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:08.841679 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2314-95c7-4a8f-b3c9-8ab3b1e5ea0f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:08.841951 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2314-95c7-4a8f-b3c9-8ab3b1e5ea0f None admin] PATH_INFO: `/v3/users/01ab831c7cc54aa29a89704fd2cfcb15` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:08.843122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b2314-95c7-4a8f-b3c9-8ab3b1e5ea0f None admin] RBAC: Authorizing `identity:get_user(user_id=01ab831c7cc54aa29a89704fd2cfcb15)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:08.845241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b2314-95c7-4a8f-b3c9-8ab3b1e5ea0f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:08.846869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 604/1197] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 13:43:08 2022] GET /identity/v3/users/01ab831c7cc54aa29a89704fd2cfcb15 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:43:08.852693 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919efa6-8f8d-4cf8-a01b-557db43f074a None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:08.952062 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919efa6-8f8d-4cf8-a01b-557db43f074a None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:08.959277 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:08.987527 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684964ff-13cd-4241-9e48-081690cf78cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:08.988201 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684964ff-13cd-4241-9e48-081690cf78cb None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:08.988486 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684964ff-13cd-4241-9e48-081690cf78cb None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:08.988761 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684964ff-13cd-4241-9e48-081690cf78cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:09.056715 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684964ff-13cd-4241-9e48-081690cf78cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:09.058101 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684964ff-13cd-4241-9e48-081690cf78cb None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:09.160649 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 594/1198] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:43:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:43:09.166675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b2314-95c7-4a8f-b3c9-8ab3b1e5ea0f None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:09.201087 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:09.268556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b2314-95c7-4a8f-b3c9-8ab3b1e5ea0f None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:09.302625 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021ee80-bd68-4a38-a24e-8715fe9310e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:09.303479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021ee80-bd68-4a38-a24e-8715fe9310e4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:09.303763 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021ee80-bd68-4a38-a24e-8715fe9310e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:09.304041 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021ee80-bd68-4a38-a24e-8715fe9310e4 None admin] PATH_INFO: `/v3/projects/a7c1674cd2be40d092920035e6a153a7` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:09.305250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021ee80-bd68-4a38-a24e-8715fe9310e4 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c1674cd2be40d092920035e6a153a7)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:09.306694 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021ee80-bd68-4a38-a24e-8715fe9310e4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:09.308489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 605/1199] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 13:43:09 2022] GET /identity/v3/projects/a7c1674cd2be40d092920035e6a153a7 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:43:09.315349 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684964ff-13cd-4241-9e48-081690cf78cb None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:09.323811 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:09.416920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684964ff-13cd-4241-9e48-081690cf78cb None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:09.451123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da7921-351d-405f-819f-f22677844547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:09.451774 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da7921-351d-405f-819f-f22677844547 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:09.452098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da7921-351d-405f-819f-f22677844547 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:09.452369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da7921-351d-405f-819f-f22677844547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:09.453204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da7921-351d-405f-819f-f22677844547 None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=a7c1674cd2be40d092920035e6a153a7, user.id=01ab831c7cc54aa29a89704fd2cfcb15) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:43:09.454170 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da7921-351d-405f-819f-f22677844547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:09.455623 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da7921-351d-405f-819f-f22677844547 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:09.461485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 595/1200] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:43:09 2022] GET /identity/v3/role_assignments?user.id=01ab831c7cc54aa29a89704fd2cfcb15&scope.project.id=a7c1674cd2be40d092920035e6a153a7&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:43:19.298251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=49 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:19.459007 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=65 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:13.771474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9c0c2-617e-4127-81bf-68690f0b78c8 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:13.771474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9c0c2-617e-4127-81bf-68690f0b78c8 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:13.771474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9c0c2-617e-4127-81bf-68690f0b78c8 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:13.773157 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 606/1201] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:44:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:13.788919 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900aefb5-f75c-47b9-b07c-810f36b9bfe4 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:13.789477 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900aefb5-f75c-47b9-b07c-810f36b9bfe4 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:13.789917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900aefb5-f75c-47b9-b07c-810f36b9bfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:13.824395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-900aefb5-f75c-47b9-b07c-810f36b9bfe4 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:13.827126 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-900aefb5-f75c-47b9-b07c-810f36b9bfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:13.977530 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 596/1202] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:44:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:44:14.029289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9c0c2-617e-4127-81bf-68690f0b78c8 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:14.264656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9c0c2-617e-4127-81bf-68690f0b78c8 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:14.343717 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ffe91-c90b-484c-b771-49a119f79ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:14.345251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ffe91-c90b-484c-b771-49a119f79ae6 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:14.345745 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ffe91-c90b-484c-b771-49a119f79ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:14.346156 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ffe91-c90b-484c-b771-49a119f79ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:14.371125 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ffe91-c90b-484c-b771-49a119f79ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:14.375146 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ffe91-c90b-484c-b771-49a119f79ae6 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-565ffe91-c90b-484c-b771-49a119f79ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:14.415604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:14.417445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:14.418554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:14.418554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:14.418554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:14.418554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:14.419259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 607/1203] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:14.433901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900aefb5-f75c-47b9-b07c-810f36b9bfe4 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:14.654422 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900aefb5-f75c-47b9-b07c-810f36b9bfe4 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:14.699489 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:14.711959 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a437d66-e0d5-47fd-af2b-aeabcaa2d9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:14.713245 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a437d66-e0d5-47fd-af2b-aeabcaa2d9b8 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:14.713554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a437d66-e0d5-47fd-af2b-aeabcaa2d9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:14.713821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a437d66-e0d5-47fd-af2b-aeabcaa2d9b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:14.714784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a437d66-e0d5-47fd-af2b-aeabcaa2d9b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:14.715099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a437d66-e0d5-47fd-af2b-aeabcaa2d9b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:14.716818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a437d66-e0d5-47fd-af2b-aeabcaa2d9b8 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:14.734439 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 597/1204] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:14.746077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ffe91-c90b-484c-b771-49a119f79ae6 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:14.872975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:14.983634 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ffe91-c90b-484c-b771-49a119f79ae6 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:15.046739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37ca0d-942b-4aaa-865e-e4673a39b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:15.048467 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37ca0d-942b-4aaa-865e-e4673a39b81f None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:15.048977 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37ca0d-942b-4aaa-865e-e4673a39b81f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:15.049453 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37ca0d-942b-4aaa-865e-e4673a39b81f None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:15.050733 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37ca0d-942b-4aaa-865e-e4673a39b81f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:15.055204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37ca0d-942b-4aaa-865e-e4673a39b81f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:15.105964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 608/1205] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 13:44:14 2022] POST /identity/v3/users => generated 251 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:44:17.949694 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b011947-d8a0-4c9e-bbee-2eb0568816dd None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:17.950436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b011947-d8a0-4c9e-bbee-2eb0568816dd None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:17.950436 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b011947-d8a0-4c9e-bbee-2eb0568816dd None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:17.952203 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 598/1206] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:44:17.958329 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe50a-6325-4621-bedf-5c459818a0dd None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:17.959036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe50a-6325-4621-bedf-5c459818a0dd None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:17.959036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe50a-6325-4621-bedf-5c459818a0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:17.981153 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-ad0fe50a-6325-4621-bedf-5c459818a0dd None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:17.982495 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-ad0fe50a-6325-4621-bedf-5c459818a0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:18.069502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 609/1207] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:44:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:44:18.096220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b011947-d8a0-4c9e-bbee-2eb0568816dd None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:18.273958 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b011947-d8a0-4c9e-bbee-2eb0568816dd None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:18.331550 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39059ddf-b0c9-4c07-aa2a-f23fa0b567c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:18.332396 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059ddf-b0c9-4c07-aa2a-f23fa0b567c6 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:18.332682 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059ddf-b0c9-4c07-aa2a-f23fa0b567c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:18.332957 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059ddf-b0c9-4c07-aa2a-f23fa0b567c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:18.347823 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39059ddf-b0c9-4c07-aa2a-f23fa0b567c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-39059ddf-b0c9-4c07-aa2a-f23fa0b567c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:44:18.356365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:18.357485 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:18.358391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 599/1208] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:44:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:44:18.365122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fe50a-6325-4621-bedf-5c459818a0dd None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:18.423504 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:18.509288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fe50a-6325-4621-bedf-5c459818a0dd None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:18.560107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95070a7-da13-4aa8-a7a9-eb510dce4b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:18.560887 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95070a7-da13-4aa8-a7a9-eb510dce4b00 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:18.561173 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95070a7-da13-4aa8-a7a9-eb510dce4b00 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:18.561450 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95070a7-da13-4aa8-a7a9-eb510dce4b00 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:18.562467 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95070a7-da13-4aa8-a7a9-eb510dce4b00 None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:18.562744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95070a7-da13-4aa8-a7a9-eb510dce4b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:18.564493 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95070a7-da13-4aa8-a7a9-eb510dce4b00 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:18.578153 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 610/1209] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:44:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:18.584804 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39059ddf-b0c9-4c07-aa2a-f23fa0b567c6 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:18.659211 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:18.731791 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39059ddf-b0c9-4c07-aa2a-f23fa0b567c6 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:18.782191 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8353be-9dc7-4347-9fb8-1d1aaaa83623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:18.783022 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8353be-9dc7-4347-9fb8-1d1aaaa83623 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:18.783312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8353be-9dc7-4347-9fb8-1d1aaaa83623 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:18.783672 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8353be-9dc7-4347-9fb8-1d1aaaa83623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:18.799113 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8353be-9dc7-4347-9fb8-1d1aaaa83623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:18.800971 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8353be-9dc7-4347-9fb8-1d1aaaa83623 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-7f8353be-9dc7-4347-9fb8-1d1aaaa83623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:18.826387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:18.828537 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:18.830823 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:18.830823 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:18.830823 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:18.830823 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:18.830823 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 600/1210] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:18.836949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95070a7-da13-4aa8-a7a9-eb510dce4b00 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:18.975986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:18.981638 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95070a7-da13-4aa8-a7a9-eb510dce4b00 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:19.034872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df455be-eaf8-40af-ad0c-850e432e2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:19.036256 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df455be-eaf8-40af-ad0c-850e432e2421 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:19.036553 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df455be-eaf8-40af-ad0c-850e432e2421 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:19.036834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df455be-eaf8-40af-ad0c-850e432e2421 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:19.037655 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df455be-eaf8-40af-ad0c-850e432e2421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:19.038022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df455be-eaf8-40af-ad0c-850e432e2421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:19.039631 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df455be-eaf8-40af-ad0c-850e432e2421 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:19.055977 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 611/1211] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:19.063098 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8353be-9dc7-4347-9fb8-1d1aaaa83623 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:19.278255 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8353be-9dc7-4347-9fb8-1d1aaaa83623 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:19.281319 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:19.348167 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad738bbe-dd45-4542-b1bb-bbd3ff31c920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:19.349594 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad738bbe-dd45-4542-b1bb-bbd3ff31c920 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:19.350107 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad738bbe-dd45-4542-b1bb-bbd3ff31c920 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:19.350620 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad738bbe-dd45-4542-b1bb-bbd3ff31c920 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:19.361448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad738bbe-dd45-4542-b1bb-bbd3ff31c920 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:19.364700 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad738bbe-dd45-4542-b1bb-bbd3ff31c920 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-ad738bbe-dd45-4542-b1bb-bbd3ff31c920 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:44:19.380877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:19.382929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:19.386993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:19.386993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:19.386993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:44:19.386993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:44:19.386993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:44:19.386993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:44:19.386993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:44:19.386993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:44:19.386993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 13:44:19.386993 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:19.388919 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 601/1212] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:44:19.390328 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df455be-eaf8-40af-ad0c-850e432e2421 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:19.551096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df455be-eaf8-40af-ad0c-850e432e2421 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:19.597225 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da885e0-1b5c-4ed3-83e5-9c32f091713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:19.597938 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da885e0-1b5c-4ed3-83e5-9c32f091713b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:19.598225 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da885e0-1b5c-4ed3-83e5-9c32f091713b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:19.598505 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da885e0-1b5c-4ed3-83e5-9c32f091713b None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:19.599371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da885e0-1b5c-4ed3-83e5-9c32f091713b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:19.599684 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da885e0-1b5c-4ed3-83e5-9c32f091713b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:19.601176 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da885e0-1b5c-4ed3-83e5-9c32f091713b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:19.620798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 612/1213] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 13:44:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:19.626003 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad738bbe-dd45-4542-b1bb-bbd3ff31c920 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:19.746556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad738bbe-dd45-4542-b1bb-bbd3ff31c920 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:19.787030 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e26140-e751-439e-84ad-bb59008efc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:19.787729 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e26140-e751-439e-84ad-bb59008efc7b None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:19.788013 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e26140-e751-439e-84ad-bb59008efc7b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:19.788315 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e26140-e751-439e-84ad-bb59008efc7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:19.823860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:19.892840 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e26140-e751-439e-84ad-bb59008efc7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:19.894324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e26140-e751-439e-84ad-bb59008efc7b None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:20.032180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 602/1214] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:44:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:44:20.038324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da885e0-1b5c-4ed3-83e5-9c32f091713b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:20.060685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:20.176391 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da885e0-1b5c-4ed3-83e5-9c32f091713b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:20.240523 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdd7dc-2c92-4c51-8780-867f95945e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:20.241946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd7dc-2c92-4c51-8780-867f95945e24 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:20.241946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd7dc-2c92-4c51-8780-867f95945e24 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:20.241946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd7dc-2c92-4c51-8780-867f95945e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:20.254575 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdd7dc-2c92-4c51-8780-867f95945e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:20.256158 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdd7dc-2c92-4c51-8780-867f95945e24 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-66bdd7dc-2c92-4c51-8780-867f95945e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:20.287963 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:20.295080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:20.296135 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:20.296135 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:20.296135 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:20.296135 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:20.296135 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 613/1215] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:20.296468 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e26140-e751-439e-84ad-bb59008efc7b None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:20.378186 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:20.426703 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e26140-e751-439e-84ad-bb59008efc7b None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:20.481853 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff117d-5dbf-40ce-b5ce-6b57ba494fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:20.482534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff117d-5dbf-40ce-b5ce-6b57ba494fd6 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:20.482819 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff117d-5dbf-40ce-b5ce-6b57ba494fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:20.483092 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff117d-5dbf-40ce-b5ce-6b57ba494fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:20.483853 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff117d-5dbf-40ce-b5ce-6b57ba494fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:20.484183 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff117d-5dbf-40ce-b5ce-6b57ba494fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:20.485564 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff117d-5dbf-40ce-b5ce-6b57ba494fd6 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:20.505214 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 603/1216] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:20.506620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdd7dc-2c92-4c51-8780-867f95945e24 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:20.640399 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:20.690520 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdd7dc-2c92-4c51-8780-867f95945e24 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:20.740506 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db173-b378-4943-aedd-72dbb54c0356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:20.741386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db173-b378-4943-aedd-72dbb54c0356 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:20.741733 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db173-b378-4943-aedd-72dbb54c0356 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:20.741988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db173-b378-4943-aedd-72dbb54c0356 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:20.750710 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2db173-b378-4943-aedd-72dbb54c0356 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:20.752378 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2db173-b378-4943-aedd-72dbb54c0356 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-ad2db173-b378-4943-aedd-72dbb54c0356 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:44:20.771407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:20.773554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:20.776091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:44:20.776091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:44:20.776091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:44:20.776091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:44:20.776091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:44:20.776091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:44:20.776091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:44:20.776091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:20.779732 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 614/1217] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:44:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:20.780520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff117d-5dbf-40ce-b5ce-6b57ba494fd6 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:20.933940 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff117d-5dbf-40ce-b5ce-6b57ba494fd6 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:20.980642 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:20.997427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529258e-5a79-48f8-a37c-abc44e0721dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:20.998218 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529258e-5a79-48f8-a37c-abc44e0721dd None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:20.998504 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529258e-5a79-48f8-a37c-abc44e0721dd None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:20.998864 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529258e-5a79-48f8-a37c-abc44e0721dd None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:20.999751 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529258e-5a79-48f8-a37c-abc44e0721dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:21.000069 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529258e-5a79-48f8-a37c-abc44e0721dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:21.001827 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529258e-5a79-48f8-a37c-abc44e0721dd None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:21.017491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 604/1218] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:44:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:21.026136 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db173-b378-4943-aedd-72dbb54c0356 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:21.164824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db173-b378-4943-aedd-72dbb54c0356 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:21.218972 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:21.231055 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5da212-cc84-4a3e-b900-0946cd2f59b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:21.231679 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5da212-cc84-4a3e-b900-0946cd2f59b9 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:21.231964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5da212-cc84-4a3e-b900-0946cd2f59b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:21.232278 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5da212-cc84-4a3e-b900-0946cd2f59b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:21.233224 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5da212-cc84-4a3e-b900-0946cd2f59b9 None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=9e134a7b368941eeb7223beb5b40c36a) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:21.234123 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5da212-cc84-4a3e-b900-0946cd2f59b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:21.235074 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5da212-cc84-4a3e-b900-0946cd2f59b9 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:21.244164 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 615/1219] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:44:21 2022] GET /identity/v3/role_assignments?user.id=9e134a7b368941eeb7223beb5b40c36a&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:44:23.600219 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa2bf9-7919-49d5-b5a3-08e0cecd1652 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:23.600973 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa2bf9-7919-49d5-b5a3-08e0cecd1652 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:23.600973 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa2bf9-7919-49d5-b5a3-08e0cecd1652 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:23.602200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 605/1220] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:23.609213 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83a2f1-e4e1-4589-843c-4dad3ec91d6f None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:23.610102 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83a2f1-e4e1-4589-843c-4dad3ec91d6f None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:23.610257 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83a2f1-e4e1-4589-843c-4dad3ec91d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:23.628451 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-9c83a2f1-e4e1-4589-843c-4dad3ec91d6f None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:23.629788 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-9c83a2f1-e4e1-4589-843c-4dad3ec91d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:23.722563 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 616/1221] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:44:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:44:23.748824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa2bf9-7919-49d5-b5a3-08e0cecd1652 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:23.871903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa2bf9-7919-49d5-b5a3-08e0cecd1652 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:23.912967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db3668-130e-4b78-8c3b-867541a302ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:23.913874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db3668-130e-4b78-8c3b-867541a302ef None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:23.914177 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db3668-130e-4b78-8c3b-867541a302ef None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:23.914450 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db3668-130e-4b78-8c3b-867541a302ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:23.928514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db3668-130e-4b78-8c3b-867541a302ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-48db3668-130e-4b78-8c3b-867541a302ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:44:23.938375 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:23.940793 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:23.943476 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 606/1222] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:44:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:23.947063 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83a2f1-e4e1-4589-843c-4dad3ec91d6f None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:24.086951 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83a2f1-e4e1-4589-843c-4dad3ec91d6f None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:24.114988 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:24.127638 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1a131-7dbe-4e11-89fc-776a359c68a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:24.128274 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1a131-7dbe-4e11-89fc-776a359c68a3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:24.128559 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1a131-7dbe-4e11-89fc-776a359c68a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:24.128834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1a131-7dbe-4e11-89fc-776a359c68a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:24.129592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1a131-7dbe-4e11-89fc-776a359c68a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:24.129897 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1a131-7dbe-4e11-89fc-776a359c68a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:24.131288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1a131-7dbe-4e11-89fc-776a359c68a3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:24.140779 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 617/1223] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:44:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:24.146825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db3668-130e-4b78-8c3b-867541a302ef None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:24.198327 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:24.272229 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db3668-130e-4b78-8c3b-867541a302ef None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:24.316911 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c2da7-958c-40e7-946e-08e7df97ed14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:24.318057 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c2da7-958c-40e7-946e-08e7df97ed14 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:24.318392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c2da7-958c-40e7-946e-08e7df97ed14 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:24.318926 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c2da7-958c-40e7-946e-08e7df97ed14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:24.335058 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c2da7-958c-40e7-946e-08e7df97ed14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:24.338040 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c2da7-958c-40e7-946e-08e7df97ed14 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-f20c2da7-958c-40e7-946e-08e7df97ed14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:24.359272 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:24.360443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:24.361499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:24.361499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:24.361499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:24.361499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:24.361499 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 607/1224] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:44:24.368902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1a131-7dbe-4e11-89fc-776a359c68a3 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:24.536424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1a131-7dbe-4e11-89fc-776a359c68a3 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:24.577116 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8595b2-b6f2-4c72-bc7c-a42f2bf721e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:24.577799 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8595b2-b6f2-4c72-bc7c-a42f2bf721e5 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:24.578092 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8595b2-b6f2-4c72-bc7c-a42f2bf721e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:24.578409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8595b2-b6f2-4c72-bc7c-a42f2bf721e5 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:24.579243 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8595b2-b6f2-4c72-bc7c-a42f2bf721e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:24.579596 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8595b2-b6f2-4c72-bc7c-a42f2bf721e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:24.581113 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8595b2-b6f2-4c72-bc7c-a42f2bf721e5 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:24.596090 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 618/1225] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:44:24.602119 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c2da7-958c-40e7-946e-08e7df97ed14 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:24.740814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:24.748660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c2da7-958c-40e7-946e-08e7df97ed14 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:24.793555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625b716-7b39-441f-96aa-82afca33b796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:24.794403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625b716-7b39-441f-96aa-82afca33b796 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:24.794782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625b716-7b39-441f-96aa-82afca33b796 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:24.795154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625b716-7b39-441f-96aa-82afca33b796 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:24.805316 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625b716-7b39-441f-96aa-82afca33b796 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:24.808099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625b716-7b39-441f-96aa-82afca33b796 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-1625b716-7b39-441f-96aa-82afca33b796 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:44:24.824701 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:24.827087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:24.829546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:24.829546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:24.829546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:44:24.829546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:44:24.829546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:44:24.829546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:44:24.829546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:44:24.829546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:44:24.829546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 13:44:24.829546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:24.829546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 608/1226] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:44:24.834546 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8595b2-b6f2-4c72-bc7c-a42f2bf721e5 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:24.896438 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:24.983474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8595b2-b6f2-4c72-bc7c-a42f2bf721e5 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:25.030444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298c48c-e2a2-4f33-b166-7389fc993d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:25.031270 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298c48c-e2a2-4f33-b166-7389fc993d5b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:25.031558 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298c48c-e2a2-4f33-b166-7389fc993d5b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:25.031832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298c48c-e2a2-4f33-b166-7389fc993d5b None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:25.032782 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298c48c-e2a2-4f33-b166-7389fc993d5b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:25.033124 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298c48c-e2a2-4f33-b166-7389fc993d5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:25.034601 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298c48c-e2a2-4f33-b166-7389fc993d5b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:25.054733 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 619/1227] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 13:44:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:44:25.061385 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625b716-7b39-441f-96aa-82afca33b796 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:25.186842 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625b716-7b39-441f-96aa-82afca33b796 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:25.241596 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cf601-3151-4eb7-b66c-6fecdf6323d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:25.242583 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cf601-3151-4eb7-b66c-6fecdf6323d6 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:25.243509 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cf601-3151-4eb7-b66c-6fecdf6323d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:25.243880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cf601-3151-4eb7-b66c-6fecdf6323d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:25.263812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cf601-3151-4eb7-b66c-6fecdf6323d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:25.266566 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cf601-3151-4eb7-b66c-6fecdf6323d6 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-bc9cf601-3151-4eb7-b66c-6fecdf6323d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:25.293364 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:25.294764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:25.295901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:25.295901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:25.295901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:25.295901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:25.295901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 609/1228] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:44:25.301427 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298c48c-e2a2-4f33-b166-7389fc993d5b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:25.439304 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298c48c-e2a2-4f33-b166-7389fc993d5b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:25.446877 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:25.490333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df0bc4-2d3f-4cfc-b809-3ff80ae46595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:25.491209 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df0bc4-2d3f-4cfc-b809-3ff80ae46595 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:25.491528 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df0bc4-2d3f-4cfc-b809-3ff80ae46595 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:25.491932 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df0bc4-2d3f-4cfc-b809-3ff80ae46595 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:25.492909 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df0bc4-2d3f-4cfc-b809-3ff80ae46595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:25.493777 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df0bc4-2d3f-4cfc-b809-3ff80ae46595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:25.495410 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df0bc4-2d3f-4cfc-b809-3ff80ae46595 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:25.513304 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 620/1229] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:25.520578 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cf601-3151-4eb7-b66c-6fecdf6323d6 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:25.534880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:25.665545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cf601-3151-4eb7-b66c-6fecdf6323d6 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:25.708456 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5ffde-9f49-455e-b4a7-42df3934cb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:25.709280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5ffde-9f49-455e-b4a7-42df3934cb1c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:25.709570 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5ffde-9f49-455e-b4a7-42df3934cb1c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:25.709853 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5ffde-9f49-455e-b4a7-42df3934cb1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:25.719590 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5ffde-9f49-455e-b4a7-42df3934cb1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:25.722561 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5ffde-9f49-455e-b4a7-42df3934cb1c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-22c5ffde-9f49-455e-b4a7-42df3934cb1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:44:25.739874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:25.741883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:25.743757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:44:25.743757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:44:25.743757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:44:25.743757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:44:25.743757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:44:25.743757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:44:25.743757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:44:25.743757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:25.743757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 610/1230] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:44:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:25.750066 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df0bc4-2d3f-4cfc-b809-3ff80ae46595 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:25.905756 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df0bc4-2d3f-4cfc-b809-3ff80ae46595 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:25.952837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b1a86-0a32-43d8-a442-b14e781fcb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:25.953530 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b1a86-0a32-43d8-a442-b14e781fcb9d None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:25.954007 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b1a86-0a32-43d8-a442-b14e781fcb9d None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:25.954348 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b1a86-0a32-43d8-a442-b14e781fcb9d None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:25.955127 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b1a86-0a32-43d8-a442-b14e781fcb9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:25.955445 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b1a86-0a32-43d8-a442-b14e781fcb9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:25.957250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b1a86-0a32-43d8-a442-b14e781fcb9d None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:25.971467 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 621/1231] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:44:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:25.977962 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5ffde-9f49-455e-b4a7-42df3934cb1c None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:26.065385 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:26.109095 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5ffde-9f49-455e-b4a7-42df3934cb1c None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:26.153538 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc1824-ac80-446e-b756-4ad084ecdd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:26.155094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1824-ac80-446e-b756-4ad084ecdd6f None admin] REQUEST_METHOD: `PUT` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:26.155094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1824-ac80-446e-b756-4ad084ecdd6f None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:26.155405 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1824-ac80-446e-b756-4ad084ecdd6f None admin] PATH_INFO: `/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/9e134a7b368941eeb7223beb5b40c36a/roles/fecd360f4074414fb38da63038e39776` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:26.182038 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc1824-ac80-446e-b756-4ad084ecdd6f None admin] RBAC: Authorizing `identity:create_grant(project_id=b57fe974dc4d4542a1dd930fc6912d39, user_id=9e134a7b368941eeb7223beb5b40c36a, role_id=fecd360f4074414fb38da63038e39776)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:26.183771 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc1824-ac80-446e-b756-4ad084ecdd6f None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:26.199252 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 611/1232] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:44:25 2022] PUT /identity/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/9e134a7b368941eeb7223beb5b40c36a/roles/fecd360f4074414fb38da63038e39776 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:44:28.872384 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7b2e-377d-4654-bea2-ef8659f998a4 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:28.872939 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7b2e-377d-4654-bea2-ef8659f998a4 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:28.872939 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7b2e-377d-4654-bea2-ef8659f998a4 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:28.874740 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 622/1233] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:28.880838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13111ef7-70ca-443e-8f90-76e6bea29af3 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:28.881373 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13111ef7-70ca-443e-8f90-76e6bea29af3 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:28.881373 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13111ef7-70ca-443e-8f90-76e6bea29af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:28.901627 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-13111ef7-70ca-443e-8f90-76e6bea29af3 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:28.902981 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-13111ef7-70ca-443e-8f90-76e6bea29af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:28.991720 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 612/1234] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:44:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:44:29.017740 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c7b2e-377d-4654-bea2-ef8659f998a4 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:29.063816 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:29.177577 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c7b2e-377d-4654-bea2-ef8659f998a4 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:29.219393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4250-eaf2-4e1d-b844-28b51e288e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:29.220241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4250-eaf2-4e1d-b844-28b51e288e93 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:29.220529 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4250-eaf2-4e1d-b844-28b51e288e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:29.220808 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4250-eaf2-4e1d-b844-28b51e288e93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:29.234394 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f4250-eaf2-4e1d-b844-28b51e288e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-a97f4250-eaf2-4e1d-b844-28b51e288e93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:44:29.243862 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:29.246151 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:29.247762 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 623/1235] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 13:44:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:29.251725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13111ef7-70ca-443e-8f90-76e6bea29af3 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:29.313777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:29.383846 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13111ef7-70ca-443e-8f90-76e6bea29af3 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:29.428977 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b99bcb-479b-4da6-8ff1-0465bdcc74a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:29.429717 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b99bcb-479b-4da6-8ff1-0465bdcc74a4 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:29.430078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b99bcb-479b-4da6-8ff1-0465bdcc74a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:29.430903 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b99bcb-479b-4da6-8ff1-0465bdcc74a4 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:29.432023 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b99bcb-479b-4da6-8ff1-0465bdcc74a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:29.432365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b99bcb-479b-4da6-8ff1-0465bdcc74a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:29.433830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b99bcb-479b-4da6-8ff1-0465bdcc74a4 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:29.443460 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 613/1236] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 13:44:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:29.449791 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4250-eaf2-4e1d-b844-28b51e288e93 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:29.564856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:29.585845 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4250-eaf2-4e1d-b844-28b51e288e93 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:29.629718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799c7d1-697a-445e-977e-6b762e776f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:29.630854 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799c7d1-697a-445e-977e-6b762e776f25 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:29.631216 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799c7d1-697a-445e-977e-6b762e776f25 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:29.631890 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799c7d1-697a-445e-977e-6b762e776f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:29.650684 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799c7d1-697a-445e-977e-6b762e776f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:29.652774 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799c7d1-697a-445e-977e-6b762e776f25 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-d799c7d1-697a-445e-977e-6b762e776f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:29.674913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:29.676884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:29.678648 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:29.678648 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:29.678648 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:29.678648 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:29.678648 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 624/1237] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:29.684784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b99bcb-479b-4da6-8ff1-0465bdcc74a4 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:29.823544 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b99bcb-479b-4da6-8ff1-0465bdcc74a4 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:29.834306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:29.864503 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc1a67-055a-4ed5-9456-2fc35f2e2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:29.865207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc1a67-055a-4ed5-9456-2fc35f2e2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:29.865506 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc1a67-055a-4ed5-9456-2fc35f2e2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:29.865849 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc1a67-055a-4ed5-9456-2fc35f2e2fc8 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:29.866574 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc1a67-055a-4ed5-9456-2fc35f2e2fc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:29.866885 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc1a67-055a-4ed5-9456-2fc35f2e2fc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:29.868846 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc1a67-055a-4ed5-9456-2fc35f2e2fc8 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:29.889688 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 614/1238] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:44:29.891238 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799c7d1-697a-445e-977e-6b762e776f25 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:30.043097 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799c7d1-697a-445e-977e-6b762e776f25 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:30.101878 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4592ff-2947-4632-85b3-7c04cf99ecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:30.103065 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4592ff-2947-4632-85b3-7c04cf99ecb9 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:30.103414 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4592ff-2947-4632-85b3-7c04cf99ecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:30.103870 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4592ff-2947-4632-85b3-7c04cf99ecb9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:30.108092 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:30.118700 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4592ff-2947-4632-85b3-7c04cf99ecb9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:30.121638 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4592ff-2947-4632-85b3-7c04cf99ecb9 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-de4592ff-2947-4632-85b3-7c04cf99ecb9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:44:30.141776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:30.144003 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:30.145386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:30.145386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:30.145386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:44:30.145386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:44:30.145386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:44:30.145386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:44:30.145386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:44:30.145386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:44:30.145386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 13:44:30.145386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:30.145386 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 625/1239] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:30.150340 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc1a67-055a-4ed5-9456-2fc35f2e2fc8 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:30.296427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc1a67-055a-4ed5-9456-2fc35f2e2fc8 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:30.355071 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a12daf-3e36-4a9d-bf8c-974d5c169149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:30.356108 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a12daf-3e36-4a9d-bf8c-974d5c169149 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:30.356665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a12daf-3e36-4a9d-bf8c-974d5c169149 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:30.357127 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a12daf-3e36-4a9d-bf8c-974d5c169149 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:30.358744 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a12daf-3e36-4a9d-bf8c-974d5c169149 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:30.359313 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a12daf-3e36-4a9d-bf8c-974d5c169149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:30.362156 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a12daf-3e36-4a9d-bf8c-974d5c169149 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:30.391398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 615/1240] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 13:44:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:30.399583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4592ff-2947-4632-85b3-7c04cf99ecb9 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:30.552358 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4592ff-2947-4632-85b3-7c04cf99ecb9 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:30.601266 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f831c-dbd9-42df-9466-e10bcf166205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:30.604463 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f831c-dbd9-42df-9466-e10bcf166205 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:30.604463 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f831c-dbd9-42df-9466-e10bcf166205 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:30.604463 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f831c-dbd9-42df-9466-e10bcf166205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:30.683918 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:30.692505 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f831c-dbd9-42df-9466-e10bcf166205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:30.693986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f831c-dbd9-42df-9466-e10bcf166205 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:30.819497 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 626/1241] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:44:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 13:44:30.827036 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a12daf-3e36-4a9d-bf8c-974d5c169149 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:30.859638 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:30.962155 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a12daf-3e36-4a9d-bf8c-974d5c169149 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:31.015722 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958f087-725c-48a0-99bd-64b920a03c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:31.016578 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958f087-725c-48a0-99bd-64b920a03c21 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:31.016888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958f087-725c-48a0-99bd-64b920a03c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:31.017264 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958f087-725c-48a0-99bd-64b920a03c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:31.032041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958f087-725c-48a0-99bd-64b920a03c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:31.034052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958f087-725c-48a0-99bd-64b920a03c21 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-7958f087-725c-48a0-99bd-64b920a03c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:31.055072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:31.061832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:31.062753 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:31.062753 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:31.062753 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:31.062753 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:31.062753 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 616/1242] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:31.063055 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f831c-dbd9-42df-9466-e10bcf166205 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:31.197980 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:31.205135 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f831c-dbd9-42df-9466-e10bcf166205 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:31.256465 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf04535-9142-448c-bd11-4a55c1aad5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:31.257058 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04535-9142-448c-bd11-4a55c1aad5c0 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:31.257342 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04535-9142-448c-bd11-4a55c1aad5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:31.257620 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04535-9142-448c-bd11-4a55c1aad5c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:31.258568 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf04535-9142-448c-bd11-4a55c1aad5c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:31.259378 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf04535-9142-448c-bd11-4a55c1aad5c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:31.260666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf04535-9142-448c-bd11-4a55c1aad5c0 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:31.276156 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 627/1243] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:31.283080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958f087-725c-48a0-99bd-64b920a03c21 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:31.388160 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:31.414363 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958f087-725c-48a0-99bd-64b920a03c21 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:31.466103 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073cfb2-5e32-4b61-a7df-c6b61d034c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:31.467392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073cfb2-5e32-4b61-a7df-c6b61d034c1b None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:31.467859 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073cfb2-5e32-4b61-a7df-c6b61d034c1b None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:31.468363 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073cfb2-5e32-4b61-a7df-c6b61d034c1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:31.478816 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073cfb2-5e32-4b61-a7df-c6b61d034c1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:31.480905 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073cfb2-5e32-4b61-a7df-c6b61d034c1b None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-b073cfb2-5e32-4b61-a7df-c6b61d034c1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:44:31.500547 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:31.502601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:31.503630 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:44:31.503630 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:44:31.503630 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:44:31.503630 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:44:31.503630 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:44:31.503630 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:44:31.503630 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:44:31.503630 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:31.503630 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 617/1244] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:31.510358 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf04535-9142-448c-bd11-4a55c1aad5c0 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:31.662306 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf04535-9142-448c-bd11-4a55c1aad5c0 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:31.725751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8651b3-8c93-493b-9a60-a66191c5ab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:31.727310 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8651b3-8c93-493b-9a60-a66191c5ab34 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:31.727752 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8651b3-8c93-493b-9a60-a66191c5ab34 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:31.728230 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8651b3-8c93-493b-9a60-a66191c5ab34 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:31.729485 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8651b3-8c93-493b-9a60-a66191c5ab34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:31.729956 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8651b3-8c93-493b-9a60-a66191c5ab34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:31.732332 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8651b3-8c93-493b-9a60-a66191c5ab34 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:31.754403 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 628/1245] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:31.766931 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073cfb2-5e32-4b61-a7df-c6b61d034c1b None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:31.955275 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073cfb2-5e32-4b61-a7df-c6b61d034c1b None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:32.023201 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c7ced-50fa-49ed-8844-f9e8ff5632e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:32.025647 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c7ced-50fa-49ed-8844-f9e8ff5632e5 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:32.026228 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c7ced-50fa-49ed-8844-f9e8ff5632e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:32.026692 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c7ced-50fa-49ed-8844-f9e8ff5632e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:32.028351 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c7ced-50fa-49ed-8844-f9e8ff5632e5 None admin] RBAC: Adding query filter params (role.id=fecd360f4074414fb38da63038e39776, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=9e134a7b368941eeb7223beb5b40c36a) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:32.028918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c7ced-50fa-49ed-8844-f9e8ff5632e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:32.031734 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c7ced-50fa-49ed-8844-f9e8ff5632e5 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:32.043198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 618/1246] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:44:31 2022] GET /identity/v3/role_assignments?user.id=9e134a7b368941eeb7223beb5b40c36a&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=fecd360f4074414fb38da63038e39776 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:34.656253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ff775-1944-4f23-9e05-de1b7e295e75 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:34.656867 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ff775-1944-4f23-9e05-de1b7e295e75 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:34.656867 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ff775-1944-4f23-9e05-de1b7e295e75 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:34.658312 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 629/1247] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:34.665937 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d378426-630f-408d-826e-036c9c5afa73 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:34.666726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d378426-630f-408d-826e-036c9c5afa73 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:34.666726 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d378426-630f-408d-826e-036c9c5afa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:34.672385 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:34.688746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-8d378426-630f-408d-826e-036c9c5afa73 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:34.690005 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-8d378426-630f-408d-826e-036c9c5afa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:34.779414 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 619/1248] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:44:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:44:34.807841 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ff775-1944-4f23-9e05-de1b7e295e75 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:34.829585 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:34.966869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ff775-1944-4f23-9e05-de1b7e295e75 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:35.024734 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0fbfb-dd75-4ebf-bffe-31ffd6752758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:35.025579 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0fbfb-dd75-4ebf-bffe-31ffd6752758 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:35.025877 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0fbfb-dd75-4ebf-bffe-31ffd6752758 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:35.026200 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0fbfb-dd75-4ebf-bffe-31ffd6752758 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:35.042158 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0fbfb-dd75-4ebf-bffe-31ffd6752758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-a5c0fbfb-dd75-4ebf-bffe-31ffd6752758 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:44:35.050511 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:35.051761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:35.053689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 630/1249] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:35.059884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d378426-630f-408d-826e-036c9c5afa73 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:35.202757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d378426-630f-408d-826e-036c9c5afa73 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:35.240347 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:35.248861 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39611ff-a60c-4442-9fa5-ad4fc3091022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:35.250108 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39611ff-a60c-4442-9fa5-ad4fc3091022 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:35.250666 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39611ff-a60c-4442-9fa5-ad4fc3091022 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:35.251238 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39611ff-a60c-4442-9fa5-ad4fc3091022 None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:35.252568 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39611ff-a60c-4442-9fa5-ad4fc3091022 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:35.253209 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39611ff-a60c-4442-9fa5-ad4fc3091022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:35.255943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39611ff-a60c-4442-9fa5-ad4fc3091022 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:35.267721 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 620/1250] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:44:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:35.273444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0fbfb-dd75-4ebf-bffe-31ffd6752758 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:35.393375 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:35.425677 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0fbfb-dd75-4ebf-bffe-31ffd6752758 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:35.475006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64115b3e-2b1d-461a-997a-dee46f27a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:35.475888 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64115b3e-2b1d-461a-997a-dee46f27a171 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:35.476251 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64115b3e-2b1d-461a-997a-dee46f27a171 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:35.476618 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64115b3e-2b1d-461a-997a-dee46f27a171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:35.494658 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64115b3e-2b1d-461a-997a-dee46f27a171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:35.495476 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64115b3e-2b1d-461a-997a-dee46f27a171 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-64115b3e-2b1d-461a-997a-dee46f27a171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:35.519131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:35.520997 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:35.522754 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:35.522754 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:35.522754 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:35.522754 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:35.526465 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 631/1251] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:35.527536 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39611ff-a60c-4442-9fa5-ad4fc3091022 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:35.667239 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39611ff-a60c-4442-9fa5-ad4fc3091022 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:35.708265 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc10b1-9ab9-4274-a764-05e65f128eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:35.708932 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc10b1-9ab9-4274-a764-05e65f128eca None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:35.709217 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc10b1-9ab9-4274-a764-05e65f128eca None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:35.709517 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc10b1-9ab9-4274-a764-05e65f128eca None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:35.710242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc10b1-9ab9-4274-a764-05e65f128eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:35.710546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc10b1-9ab9-4274-a764-05e65f128eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:35.712497 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc10b1-9ab9-4274-a764-05e65f128eca None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:35.726100 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 621/1252] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:44:35.732614 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64115b3e-2b1d-461a-997a-dee46f27a171 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:35.873607 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64115b3e-2b1d-461a-997a-dee46f27a171 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:35.920583 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:35.940431 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42d874-eaa5-47dc-9cb1-5486780a3016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:35.941742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42d874-eaa5-47dc-9cb1-5486780a3016 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:35.942204 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42d874-eaa5-47dc-9cb1-5486780a3016 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:35.942674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42d874-eaa5-47dc-9cb1-5486780a3016 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:35.956065 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42d874-eaa5-47dc-9cb1-5486780a3016 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:35.958781 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42d874-eaa5-47dc-9cb1-5486780a3016 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-8c42d874-eaa5-47dc-9cb1-5486780a3016 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:44:35.984072 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:35.985834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:35.987576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:35.987576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:35.987576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:44:35.987576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:44:35.987576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:44:35.987576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:44:35.987576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:44:35.987576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:44:35.987576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 13:44:35.987576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:35.987576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 632/1253] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:35.993307 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc10b1-9ab9-4274-a764-05e65f128eca None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:36.065428 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:36.123343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc10b1-9ab9-4274-a764-05e65f128eca None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:36.166970 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a545f69-34e0-4185-a5a1-29efa5224af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:36.167605 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a545f69-34e0-4185-a5a1-29efa5224af2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:36.167877 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a545f69-34e0-4185-a5a1-29efa5224af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:36.168187 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a545f69-34e0-4185-a5a1-29efa5224af2 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:36.169057 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a545f69-34e0-4185-a5a1-29efa5224af2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:36.169404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a545f69-34e0-4185-a5a1-29efa5224af2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:36.170970 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a545f69-34e0-4185-a5a1-29efa5224af2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:36.190764 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 622/1254] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 13:44:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:36.197270 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42d874-eaa5-47dc-9cb1-5486780a3016 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:36.335476 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42d874-eaa5-47dc-9cb1-5486780a3016 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:36.374589 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df3737-adff-4cb5-b3cb-89e5f30191a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:36.375248 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df3737-adff-4cb5-b3cb-89e5f30191a3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:36.375529 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df3737-adff-4cb5-b3cb-89e5f30191a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:36.375803 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df3737-adff-4cb5-b3cb-89e5f30191a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:36.447312 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:36.468067 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df3737-adff-4cb5-b3cb-89e5f30191a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:36.470374 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df3737-adff-4cb5-b3cb-89e5f30191a3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:36.588809 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 633/1255] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:44:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 13:44:36.595601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a545f69-34e0-4185-a5a1-29efa5224af2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:36.738143 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a545f69-34e0-4185-a5a1-29efa5224af2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:36.758218 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:36.786434 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52acc5d-10d6-402a-afdc-b30d5a1a12ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:36.787742 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52acc5d-10d6-402a-afdc-b30d5a1a12ed None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:36.788430 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52acc5d-10d6-402a-afdc-b30d5a1a12ed None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:36.789410 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52acc5d-10d6-402a-afdc-b30d5a1a12ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:36.802770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52acc5d-10d6-402a-afdc-b30d5a1a12ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:36.805154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52acc5d-10d6-402a-afdc-b30d5a1a12ed None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-b52acc5d-10d6-402a-afdc-b30d5a1a12ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:36.827585 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:36.828814 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:36.829797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:36.829797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:36.829797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:36.829797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:36.834751 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 623/1256] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:36.835709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df3737-adff-4cb5-b3cb-89e5f30191a3 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:36.965425 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:36.983217 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df3737-adff-4cb5-b3cb-89e5f30191a3 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:37.029964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f689764-2229-4895-93db-3aeac13ef1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:37.030851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f689764-2229-4895-93db-3aeac13ef1e3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:37.031235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f689764-2229-4895-93db-3aeac13ef1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:37.031665 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f689764-2229-4895-93db-3aeac13ef1e3 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:37.032675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f689764-2229-4895-93db-3aeac13ef1e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:37.033100 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f689764-2229-4895-93db-3aeac13ef1e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:37.034709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f689764-2229-4895-93db-3aeac13ef1e3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:37.056055 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 634/1257] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:44:37.057611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52acc5d-10d6-402a-afdc-b30d5a1a12ed None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:37.208426 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52acc5d-10d6-402a-afdc-b30d5a1a12ed None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:37.254968 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e31c0-1946-44d2-86d5-f20f776f5aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:37.255712 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e31c0-1946-44d2-86d5-f20f776f5aff None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:37.255992 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e31c0-1946-44d2-86d5-f20f776f5aff None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:37.256401 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e31c0-1946-44d2-86d5-f20f776f5aff None admin] PATH_INFO: `/v3/projects/service` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:37.264577 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e31c0-1946-44d2-86d5-f20f776f5aff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:37.266068 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e31c0-1946-44d2-86d5-f20f776f5aff None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-6d6e31c0-1946-44d2-86d5-f20f776f5aff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:44:37.282025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:37.283154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:37.284099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:44:37.284099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:44:37.284099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:44:37.284099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:44:37.284099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:44:37.284099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:44:37.284099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:44:37.284099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:37.284099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 624/1258] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:37.297546 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f689764-2229-4895-93db-3aeac13ef1e3 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:37.421666 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f689764-2229-4895-93db-3aeac13ef1e3 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:37.463507 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca0d85-76b7-4f05-bf1a-728dc811e8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:37.464462 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca0d85-76b7-4f05-bf1a-728dc811e8c3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:37.464755 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca0d85-76b7-4f05-bf1a-728dc811e8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:37.465025 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca0d85-76b7-4f05-bf1a-728dc811e8c3 None admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:37.465837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca0d85-76b7-4f05-bf1a-728dc811e8c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:37.466146 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca0d85-76b7-4f05-bf1a-728dc811e8c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:37.467644 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca0d85-76b7-4f05-bf1a-728dc811e8c3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:37.482519 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 635/1259] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:37.490516 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e31c0-1946-44d2-86d5-f20f776f5aff None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:37.522758 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:37.621620 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e31c0-1946-44d2-86d5-f20f776f5aff None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:37.662384 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b434321-ebfe-4fb3-9643-ba1348be2bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:37.663067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b434321-ebfe-4fb3-9643-ba1348be2bee None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:37.663349 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b434321-ebfe-4fb3-9643-ba1348be2bee None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:37.664185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b434321-ebfe-4fb3-9643-ba1348be2bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:37.665021 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b434321-ebfe-4fb3-9643-ba1348be2bee None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=9e134a7b368941eeb7223beb5b40c36a) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:37.665335 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b434321-ebfe-4fb3-9643-ba1348be2bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:37.666821 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b434321-ebfe-4fb3-9643-ba1348be2bee None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:37.673292 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 625/1260] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:44:37 2022] GET /identity/v3/role_assignments?user.id=9e134a7b368941eeb7223beb5b40c36a&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:39.925684 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3dd9d-08b9-4d9c-9d41-ee3e267119a3 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:39.926439 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3dd9d-08b9-4d9c-9d41-ee3e267119a3 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:39.926439 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3dd9d-08b9-4d9c-9d41-ee3e267119a3 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:39.928043 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 636/1261] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:39.937044 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3e6c6-f99e-49b8-b947-7033ed24f080 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:39.938074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3e6c6-f99e-49b8-b947-7033ed24f080 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:39.938229 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3e6c6-f99e-49b8-b947-7033ed24f080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:39.962660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-10b3e6c6-f99e-49b8-b947-7033ed24f080 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:39.963876 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-10b3e6c6-f99e-49b8-b947-7033ed24f080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:40.047569 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 626/1262] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:44:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:44:40.071346 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3dd9d-08b9-4d9c-9d41-ee3e267119a3 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:40.083122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:40.187120 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3dd9d-08b9-4d9c-9d41-ee3e267119a3 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:40.222321 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab230211-b54f-4114-a7cf-6d6885c53535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:40.223027 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab230211-b54f-4114-a7cf-6d6885c53535 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:40.223307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab230211-b54f-4114-a7cf-6d6885c53535 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:40.223574 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab230211-b54f-4114-a7cf-6d6885c53535 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:40.235057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab230211-b54f-4114-a7cf-6d6885c53535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-ab230211-b54f-4114-a7cf-6d6885c53535 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:44:40.243289 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:40.244479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:40.245380 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 637/1263] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:44:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:40.251066 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3e6c6-f99e-49b8-b947-7033ed24f080 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:40.269657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:40.360465 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3e6c6-f99e-49b8-b947-7033ed24f080 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:40.395391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e60dd-c511-45bc-a15a-53f7527009fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:40.396053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e60dd-c511-45bc-a15a-53f7527009fe None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:40.396359 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e60dd-c511-45bc-a15a-53f7527009fe None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:40.396632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e60dd-c511-45bc-a15a-53f7527009fe None admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:40.397384 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e60dd-c511-45bc-a15a-53f7527009fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:40.398245 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e60dd-c511-45bc-a15a-53f7527009fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:40.400294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e60dd-c511-45bc-a15a-53f7527009fe None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:40.409277 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 627/1264] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:44:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:44:40.415554 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab230211-b54f-4114-a7cf-6d6885c53535 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:40.487919 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:40.525102 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab230211-b54f-4114-a7cf-6d6885c53535 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:40.559336 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5a9d3-b73a-4323-8d3a-30a9031e9f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:40.560158 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5a9d3-b73a-4323-8d3a-30a9031e9f2b None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:40.560448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5a9d3-b73a-4323-8d3a-30a9031e9f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:40.560724 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5a9d3-b73a-4323-8d3a-30a9031e9f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:40.572596 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5a9d3-b73a-4323-8d3a-30a9031e9f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:40.574190 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5a9d3-b73a-4323-8d3a-30a9031e9f2b None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-a3b5a9d3-b73a-4323-8d3a-30a9031e9f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:40.592492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:40.593599 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:40.594515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:40.594515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:40.594515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:40.594515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:40.594515 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 638/1265] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:40.599848 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e60dd-c511-45bc-a15a-53f7527009fe None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:40.686970 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:40.712370 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e60dd-c511-45bc-a15a-53f7527009fe None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:40.749324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8b8d2-dae1-4422-abb5-6023f68c5f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:40.749901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8b8d2-dae1-4422-abb5-6023f68c5f9e None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:40.750184 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8b8d2-dae1-4422-abb5-6023f68c5f9e None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:40.750459 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8b8d2-dae1-4422-abb5-6023f68c5f9e None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:40.751191 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8b8d2-dae1-4422-abb5-6023f68c5f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:40.751497 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8b8d2-dae1-4422-abb5-6023f68c5f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:40.752899 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8b8d2-dae1-4422-abb5-6023f68c5f9e None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:40.765920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 628/1266] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:40.773802 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5a9d3-b73a-4323-8d3a-30a9031e9f2b None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:40.877263 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5a9d3-b73a-4323-8d3a-30a9031e9f2b None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:40.897357 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:40.920592 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2d4a5-fe2a-48ff-8e71-60b454105d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:40.921932 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2d4a5-fe2a-48ff-8e71-60b454105d9f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:40.922337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2d4a5-fe2a-48ff-8e71-60b454105d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:40.922722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2d4a5-fe2a-48ff-8e71-60b454105d9f None admin] PATH_INFO: `/v3/users/placement` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:40.935693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2d4a5-fe2a-48ff-8e71-60b454105d9f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:40.937383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2d4a5-fe2a-48ff-8e71-60b454105d9f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-11c2d4a5-fe2a-48ff-8e71-60b454105d9f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:44:40.956948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:40.958790 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:40.959844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:40.959844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:40.959844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:44:40.959844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:44:40.959844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:44:40.959844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:44:40.959844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:44:40.959844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:44:40.959844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 13:44:40.959844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:40.959844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 639/1267] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:44:40.965930 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8b8d2-dae1-4422-abb5-6023f68c5f9e None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:41.073430 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8b8d2-dae1-4422-abb5-6023f68c5f9e None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:41.108525 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53743d6d-0a0d-452f-adb1-f43faad86f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:41.109220 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53743d6d-0a0d-452f-adb1-f43faad86f70 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:41.109504 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53743d6d-0a0d-452f-adb1-f43faad86f70 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:41.109782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53743d6d-0a0d-452f-adb1-f43faad86f70 None admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:41.110646 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53743d6d-0a0d-452f-adb1-f43faad86f70 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:41.110957 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53743d6d-0a0d-452f-adb1-f43faad86f70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:41.112470 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53743d6d-0a0d-452f-adb1-f43faad86f70 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:41.123109 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:41.133408 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 629/1268] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 13:44:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:41.139284 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2d4a5-fe2a-48ff-8e71-60b454105d9f None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:41.249705 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2d4a5-fe2a-48ff-8e71-60b454105d9f None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:41.284173 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9158c3-1955-4e89-ad09-fa7acbf05bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:41.284964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9158c3-1955-4e89-ad09-fa7acbf05bb6 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:41.285245 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9158c3-1955-4e89-ad09-fa7acbf05bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:41.285517 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9158c3-1955-4e89-ad09-fa7acbf05bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:41.296913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9158c3-1955-4e89-ad09-fa7acbf05bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:41.298368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9158c3-1955-4e89-ad09-fa7acbf05bb6 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-ce9158c3-1955-4e89-ad09-fa7acbf05bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:41.316392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:41.318107 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:41.320212 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:41.320212 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:41.320212 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:41.320212 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:41.320212 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 640/1269] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:41.326816 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53743d6d-0a0d-452f-adb1-f43faad86f70 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:41.441275 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53743d6d-0a0d-452f-adb1-f43faad86f70 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:41.477401 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f4d02-7891-4e45-93a6-743681751d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:41.478065 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f4d02-7891-4e45-93a6-743681751d06 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:41.478350 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f4d02-7891-4e45-93a6-743681751d06 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:41.478629 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f4d02-7891-4e45-93a6-743681751d06 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:41.479365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f4d02-7891-4e45-93a6-743681751d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:41.479676 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f4d02-7891-4e45-93a6-743681751d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:41.481083 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f4d02-7891-4e45-93a6-743681751d06 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:41.493286 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 630/1270] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:41.499039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9158c3-1955-4e89-ad09-fa7acbf05bb6 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:41.532338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:41.604435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9158c3-1955-4e89-ad09-fa7acbf05bb6 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:41.640368 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9e8af-a6a2-45c0-a04e-67197dafb938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:41.641165 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9e8af-a6a2-45c0-a04e-67197dafb938 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:41.641442 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9e8af-a6a2-45c0-a04e-67197dafb938 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:41.641712 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9e8af-a6a2-45c0-a04e-67197dafb938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:41.649460 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9e8af-a6a2-45c0-a04e-67197dafb938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:41.650949 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9e8af-a6a2-45c0-a04e-67197dafb938 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-85e9e8af-a6a2-45c0-a04e-67197dafb938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:44:41.666196 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:41.667452 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:41.668689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:44:41.668689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:44:41.668689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:44:41.668689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:44:41.668689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:44:41.668689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:44:41.668689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:44:41.668689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:41.668689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 641/1271] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:41.674758 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f4d02-7891-4e45-93a6-743681751d06 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:41.736089 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:41.780250 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f4d02-7891-4e45-93a6-743681751d06 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:41.815051 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb037b71-6e78-4a9a-b17e-7118d77c0950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:41.815704 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb037b71-6e78-4a9a-b17e-7118d77c0950 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:41.815984 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb037b71-6e78-4a9a-b17e-7118d77c0950 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:41.816290 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb037b71-6e78-4a9a-b17e-7118d77c0950 None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:41.817074 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb037b71-6e78-4a9a-b17e-7118d77c0950 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:41.817381 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb037b71-6e78-4a9a-b17e-7118d77c0950 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:41.818794 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb037b71-6e78-4a9a-b17e-7118d77c0950 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:41.831841 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 631/1272] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:41.838021 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9e8af-a6a2-45c0-a04e-67197dafb938 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:41.947740 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:41.957467 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9e8af-a6a2-45c0-a04e-67197dafb938 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:41.995991 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a870d-1de1-428a-97a5-2d7068d09143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:41.996911 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a870d-1de1-428a-97a5-2d7068d09143 None admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:41.997191 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a870d-1de1-428a-97a5-2d7068d09143 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:41.997468 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a870d-1de1-428a-97a5-2d7068d09143 None admin] PATH_INFO: `/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/9e134a7b368941eeb7223beb5b40c36a/roles/109ea861e27e4d75bec3ac9c5f81096e` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:41.999426 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a870d-1de1-428a-97a5-2d7068d09143 None admin] RBAC: Authorizing `identity:create_grant(project_id=b57fe974dc4d4542a1dd930fc6912d39, user_id=9e134a7b368941eeb7223beb5b40c36a, role_id=109ea861e27e4d75bec3ac9c5f81096e)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:42.000905 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a870d-1de1-428a-97a5-2d7068d09143 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:42.014795 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 642/1273] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 13:44:41 2022] PUT /identity/v3/projects/b57fe974dc4d4542a1dd930fc6912d39/users/9e134a7b368941eeb7223beb5b40c36a/roles/109ea861e27e4d75bec3ac9c5f81096e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:44:44.271374 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73794f4-97c8-4d1f-8825-0c3aedc90275 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:44.271915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73794f4-97c8-4d1f-8825-0c3aedc90275 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:44.271915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73794f4-97c8-4d1f-8825-0c3aedc90275 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:44.273342 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 632/1274] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:44.279479 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df581c1-fceb-4fa6-90b7-69c38dbfda90 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:44.279930 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df581c1-fceb-4fa6-90b7-69c38dbfda90 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:44.280037 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df581c1-fceb-4fa6-90b7-69c38dbfda90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:44.302272 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-7df581c1-fceb-4fa6-90b7-69c38dbfda90 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:44.304860 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-7df581c1-fceb-4fa6-90b7-69c38dbfda90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:44.386885 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 643/1275] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:44:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:44:44.411090 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73794f4-97c8-4d1f-8825-0c3aedc90275 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:44.541213 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73794f4-97c8-4d1f-8825-0c3aedc90275 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:44.559321 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:44.576902 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f311911-93c0-4c74-802d-6bf9207b24c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:44.577702 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f311911-93c0-4c74-802d-6bf9207b24c2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:44.577990 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f311911-93c0-4c74-802d-6bf9207b24c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:44.578271 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f311911-93c0-4c74-802d-6bf9207b24c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:44.589444 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f311911-93c0-4c74-802d-6bf9207b24c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-7f311911-93c0-4c74-802d-6bf9207b24c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:44:44.597080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:44.598552 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:44.599904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 633/1276] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 13:44:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:44.605046 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df581c1-fceb-4fa6-90b7-69c38dbfda90 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:44.694679 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:44.715983 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df581c1-fceb-4fa6-90b7-69c38dbfda90 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:44.756472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d25e2a-5b38-41f7-a0e5-a368d99a9d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:44.757370 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d25e2a-5b38-41f7-a0e5-a368d99a9d25 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:44.757690 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d25e2a-5b38-41f7-a0e5-a368d99a9d25 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:44.758018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d25e2a-5b38-41f7-a0e5-a368d99a9d25 None admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:44.758864 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d25e2a-5b38-41f7-a0e5-a368d99a9d25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:44.759213 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d25e2a-5b38-41f7-a0e5-a368d99a9d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:44.760845 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d25e2a-5b38-41f7-a0e5-a368d99a9d25 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:44.772901 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 644/1277] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 13:44:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:44.779824 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f311911-93c0-4c74-802d-6bf9207b24c2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:44.908852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f311911-93c0-4c74-802d-6bf9207b24c2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:44.960478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624dbda-926d-4c79-9cc0-0705df9ea027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:44.961442 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624dbda-926d-4c79-9cc0-0705df9ea027 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:44.961819 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624dbda-926d-4c79-9cc0-0705df9ea027 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:44.962076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624dbda-926d-4c79-9cc0-0705df9ea027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:44.977263 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624dbda-926d-4c79-9cc0-0705df9ea027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:44.979017 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624dbda-926d-4c79-9cc0-0705df9ea027 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-a624dbda-926d-4c79-9cc0-0705df9ea027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:45.000205 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:45.001398 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:45.002698 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:45.002698 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:45.002698 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:45.002698 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:45.002698 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 634/1278] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:45.008205 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d25e2a-5b38-41f7-a0e5-a368d99a9d25 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:45.117254 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d25e2a-5b38-41f7-a0e5-a368d99a9d25 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:45.152225 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790ed2d-847c-42f6-85d2-5792ab96e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:45.152892 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790ed2d-847c-42f6-85d2-5792ab96e165 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:45.153174 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790ed2d-847c-42f6-85d2-5792ab96e165 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:45.153447 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790ed2d-847c-42f6-85d2-5792ab96e165 None admin] PATH_INFO: `/v3/domains` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:45.154170 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790ed2d-847c-42f6-85d2-5792ab96e165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:45.154475 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790ed2d-847c-42f6-85d2-5792ab96e165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:45.155852 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790ed2d-847c-42f6-85d2-5792ab96e165 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:45.167891 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 645/1279] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:45.173606 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624dbda-926d-4c79-9cc0-0705df9ea027 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:45.212063 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:45.283577 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624dbda-926d-4c79-9cc0-0705df9ea027 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:45.321807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827727cd-a79e-4e9a-88ff-ebd0e9b2f650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:45.322608 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827727cd-a79e-4e9a-88ff-ebd0e9b2f650 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:45.322894 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827727cd-a79e-4e9a-88ff-ebd0e9b2f650 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:45.323165 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827727cd-a79e-4e9a-88ff-ebd0e9b2f650 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:45.330937 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827727cd-a79e-4e9a-88ff-ebd0e9b2f650 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:45.332411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827727cd-a79e-4e9a-88ff-ebd0e9b2f650 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-827727cd-a79e-4e9a-88ff-ebd0e9b2f650 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:44:45.347054 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:45.348270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:45.349273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:45.349273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:45.349273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:44:45.349273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:44:45.349273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:44:45.349273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:44:45.349273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:44:45.349273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:44:45.349273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 13:44:45.349273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:45.349273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 635/1280] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:45.354704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790ed2d-847c-42f6-85d2-5792ab96e165 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:45.358586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:45.457393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790ed2d-847c-42f6-85d2-5792ab96e165 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:45.494015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322edda-050c-4bb9-b5dc-f1036df983a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:45.494693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322edda-050c-4bb9-b5dc-f1036df983a3 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:45.494975 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322edda-050c-4bb9-b5dc-f1036df983a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:45.495250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322edda-050c-4bb9-b5dc-f1036df983a3 None admin] PATH_INFO: `/v3/users` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:45.496092 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322edda-050c-4bb9-b5dc-f1036df983a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:45.496435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322edda-050c-4bb9-b5dc-f1036df983a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:45.497884 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322edda-050c-4bb9-b5dc-f1036df983a3 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:45.517117 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 646/1281] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 13:44:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:45.523032 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827727cd-a79e-4e9a-88ff-ebd0e9b2f650 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:45.615612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:45.626624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827727cd-a79e-4e9a-88ff-ebd0e9b2f650 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:45.662026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f9655-1097-499e-a458-0397655afedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:45.662672 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f9655-1097-499e-a458-0397655afedc None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:45.663659 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f9655-1097-499e-a458-0397655afedc None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:45.664009 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f9655-1097-499e-a458-0397655afedc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:45.733018 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f9655-1097-499e-a458-0397655afedc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:45.734392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f9655-1097-499e-a458-0397655afedc None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:45.823925 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:45.834529 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 636/1282] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 13:44:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:44:45.841210 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322edda-050c-4bb9-b5dc-f1036df983a3 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:45.909868 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:45.951556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322edda-050c-4bb9-b5dc-f1036df983a3 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:45.988503 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2c747-7637-4459-9b8f-661c2186691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:45.989202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2c747-7637-4459-9b8f-661c2186691e None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:45.994437 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2c747-7637-4459-9b8f-661c2186691e None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:45.994437 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2c747-7637-4459-9b8f-661c2186691e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:46.001439 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2c747-7637-4459-9b8f-661c2186691e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:46.002914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2c747-7637-4459-9b8f-661c2186691e None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-d4b2c747-7637-4459-9b8f-661c2186691e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:44:46.021013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:46.022651 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:46.023751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:44:46.023751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:44:46.023751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:44:46.023751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:46.023751 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 647/1283] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:44:46.028647 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f9655-1097-499e-a458-0397655afedc None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:46.127607 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f9655-1097-499e-a458-0397655afedc None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:46.161023 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ae834-3b10-4c07-88a1-6f6a9a49cc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:46.161680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae834-3b10-4c07-88a1-6f6a9a49cc32 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:46.161963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae834-3b10-4c07-88a1-6f6a9a49cc32 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:46.162239 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae834-3b10-4c07-88a1-6f6a9a49cc32 None admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:46.163494 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ae834-3b10-4c07-88a1-6f6a9a49cc32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:46.163796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ae834-3b10-4c07-88a1-6f6a9a49cc32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:46.165278 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ae834-3b10-4c07-88a1-6f6a9a49cc32 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:46.176336 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 637/1284] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 13:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:46.182829 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2c747-7637-4459-9b8f-661c2186691e None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:46.285302 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2c747-7637-4459-9b8f-661c2186691e None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:46.299498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:46.322270 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544759d6-152d-4416-84f1-73929a5f58c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:46.323190 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544759d6-152d-4416-84f1-73929a5f58c9 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:46.323473 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544759d6-152d-4416-84f1-73929a5f58c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:46.323742 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544759d6-152d-4416-84f1-73929a5f58c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:46.330659 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544759d6-152d-4416-84f1-73929a5f58c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:46.332147 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544759d6-152d-4416-84f1-73929a5f58c9 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application [None req-544759d6-152d-4416-84f1-73929a5f58c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:44:46.346900 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application with Lock( May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:46.347986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:46.349122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:44:46.349122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:44:46.349122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:44:46.349122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:44:46.349122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:44:46.349122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:44:46.349122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:44:46.349122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: ERROR keystone.server.flask.application May 25 13:44:46.349122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 648/1285] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 13:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:46.354992 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ae834-3b10-4c07-88a1-6f6a9a49cc32 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:46.414425 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:46.468888 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ae834-3b10-4c07-88a1-6f6a9a49cc32 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:46.506528 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f434bfd-d5e4-4be9-98f5-2d2493e163da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:46.507416 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f434bfd-d5e4-4be9-98f5-2d2493e163da None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:46.507589 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f434bfd-d5e4-4be9-98f5-2d2493e163da None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:46.507750 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f434bfd-d5e4-4be9-98f5-2d2493e163da None admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:46.508573 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f434bfd-d5e4-4be9-98f5-2d2493e163da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:46.508940 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f434bfd-d5e4-4be9-98f5-2d2493e163da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:46.510333 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f434bfd-d5e4-4be9-98f5-2d2493e163da None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:46.526825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 638/1286] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 13:44:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:46.533227 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544759d6-152d-4416-84f1-73929a5f58c9 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:46.647036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544759d6-152d-4416-84f1-73929a5f58c9 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:46.683692 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d739f-d2e0-494f-a6cb-64b001ff9727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:46.684369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d739f-d2e0-494f-a6cb-64b001ff9727 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:46.684649 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d739f-d2e0-494f-a6cb-64b001ff9727 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:46.684918 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d739f-d2e0-494f-a6cb-64b001ff9727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:46.685749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d739f-d2e0-494f-a6cb-64b001ff9727 None admin] RBAC: Adding query filter params (role.id=109ea861e27e4d75bec3ac9c5f81096e, scope.project.id=b57fe974dc4d4542a1dd930fc6912d39, user.id=9e134a7b368941eeb7223beb5b40c36a) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:46.686056 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d739f-d2e0-494f-a6cb-64b001ff9727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:46.687494 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d739f-d2e0-494f-a6cb-64b001ff9727 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:46.693610 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 649/1287] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 13:44:46 2022] GET /identity/v3/role_assignments?user.id=9e134a7b368941eeb7223beb5b40c36a&scope.project.id=b57fe974dc4d4542a1dd930fc6912d39&role.id=109ea861e27e4d75bec3ac9c5f81096e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:48.977056 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccfd18-b8f0-4ebc-909b-5722e75037a2 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:48.977574 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccfd18-b8f0-4ebc-909b-5722e75037a2 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:48.977574 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccfd18-b8f0-4ebc-909b-5722e75037a2 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:48.978899 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 639/1288] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:48.984280 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980cb3d-c7f1-4ca4-9068-6eff5760d3d8 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:48.984741 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980cb3d-c7f1-4ca4-9068-6eff5760d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:48.984844 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980cb3d-c7f1-4ca4-9068-6eff5760d3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:49.002626 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-a980cb3d-c7f1-4ca4-9068-6eff5760d3d8 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:49.003851 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-a980cb3d-c7f1-4ca4-9068-6eff5760d3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:49.034189 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:49.073395 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 650/1289] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:44:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:44:49.096344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccfd18-b8f0-4ebc-909b-5722e75037a2 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:49.199258 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccfd18-b8f0-4ebc-909b-5722e75037a2 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:49.211742 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:49.236242 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cc527-87ad-4a76-93c2-978a401005c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:49.236961 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cc527-87ad-4a76-93c2-978a401005c2 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:49.237243 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cc527-87ad-4a76-93c2-978a401005c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:49.237515 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cc527-87ad-4a76-93c2-978a401005c2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:49.238161 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cc527-87ad-4a76-93c2-978a401005c2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:49.239521 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cc527-87ad-4a76-93c2-978a401005c2 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-257cc527-87ad-4a76-93c2-978a401005c2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:49.252000 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:49.253312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:49.254391 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 640/1290] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 13:44:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:49.260060 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980cb3d-c7f1-4ca4-9068-6eff5760d3d8 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:49.365296 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980cb3d-c7f1-4ca4-9068-6eff5760d3d8 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:49.404018 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb94cd-5903-4f79-860f-5bcaec426141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:49.404761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb94cd-5903-4f79-860f-5bcaec426141 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:49.405085 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb94cd-5903-4f79-860f-5bcaec426141 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:49.405324 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb94cd-5903-4f79-860f-5bcaec426141 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:49.406034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb94cd-5903-4f79-860f-5bcaec426141 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:49.406340 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb94cd-5903-4f79-860f-5bcaec426141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:49.407731 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb94cd-5903-4f79-860f-5bcaec426141 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:49.413572 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 651/1291] 10.222.0.24 () {56 vars in 1116 bytes} [Wed May 25 13:44:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:49.420479 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cc527-87ad-4a76-93c2-978a401005c2 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:49.531470 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cc527-87ad-4a76-93c2-978a401005c2 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:49.565855 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb9769-889b-453e-8fab-e6c0a783ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:49.566525 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb9769-889b-453e-8fab-e6c0a783ed2c None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:49.566809 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb9769-889b-453e-8fab-e6c0a783ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:49.567086 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb9769-889b-453e-8fab-e6c0a783ed2c None admin] PATH_INFO: `/v3/services` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:49.567801 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb9769-889b-453e-8fab-e6c0a783ed2c None admin] RBAC: Adding query filter params (type=placement) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:49.568139 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb9769-889b-453e-8fab-e6c0a783ed2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:49.570723 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb9769-889b-453e-8fab-e6c0a783ed2c None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:49.575709 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 641/1292] 10.222.0.24 () {56 vars in 1116 bytes} [Wed May 25 13:44:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:51.879080 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327762-67f5-48f2-91c4-2d1f20c35141 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:51.879639 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327762-67f5-48f2-91c4-2d1f20c35141 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:51.880031 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327762-67f5-48f2-91c4-2d1f20c35141 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:51.882701 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 652/1293] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:44:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:51.889894 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eedec4-edda-479a-9733-90033668c4b3 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:51.890343 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eedec4-edda-479a-9733-90033668c4b3 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:51.890553 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eedec4-edda-479a-9733-90033668c4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:51.920407 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-25eedec4-edda-479a-9733-90033668c4b3 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:51.922393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-25eedec4-edda-479a-9733-90033668c4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:51.965106 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:52.009738 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 642/1294] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:44:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:44:52.033737 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327762-67f5-48f2-91c4-2d1f20c35141 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:52.070115 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:52.148761 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327762-67f5-48f2-91c4-2d1f20c35141 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:52.185327 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c9488-cabf-491e-994a-b6c6f3b83abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:52.185994 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c9488-cabf-491e-994a-b6c6f3b83abe None admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:52.186275 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c9488-cabf-491e-994a-b6c6f3b83abe None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:52.186551 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c9488-cabf-491e-994a-b6c6f3b83abe None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:52.187286 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c9488-cabf-491e-994a-b6c6f3b83abe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:52.188702 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c9488-cabf-491e-994a-b6c6f3b83abe None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:52.208687 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 653/1295] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 13:44:52 2022] POST /identity/v3/services => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:44:54.520805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e042719-170d-4f12-a4ec-4ae2aa034fc2 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:54.521836 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e042719-170d-4f12-a4ec-4ae2aa034fc2 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:54.521923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e042719-170d-4f12-a4ec-4ae2aa034fc2 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:54.523277 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 643/1296] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:54.528669 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d499f9-b99e-4c95-b7c3-f1691d8ced92 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:54.529105 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d499f9-b99e-4c95-b7c3-f1691d8ced92 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:54.529225 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d499f9-b99e-4c95-b7c3-f1691d8ced92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:54.553202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-23d499f9-b99e-4c95-b7c3-f1691d8ced92 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:54.554455 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-23d499f9-b99e-4c95-b7c3-f1691d8ced92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:54.631409 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 654/1297] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:44:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:44:54.655441 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e042719-170d-4f12-a4ec-4ae2aa034fc2 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:54.767507 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e042719-170d-4f12-a4ec-4ae2aa034fc2 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:54.802248 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481632d-ec1e-44f7-a244-bb796c4c9f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:54.803241 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481632d-ec1e-44f7-a244-bb796c4c9f42 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:54.803524 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481632d-ec1e-44f7-a244-bb796c4c9f42 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:54.803799 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481632d-ec1e-44f7-a244-bb796c4c9f42 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:54.804483 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481632d-ec1e-44f7-a244-bb796c4c9f42 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:54.805859 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481632d-ec1e-44f7-a244-bb796c4c9f42 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-b481632d-ec1e-44f7-a244-bb796c4c9f42 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:54.817784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:54.819927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:54.820999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 644/1298] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 13:44:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:54.825839 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d499f9-b99e-4c95-b7c3-f1691d8ced92 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:54.846537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:54.938022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d499f9-b99e-4c95-b7c3-f1691d8ced92 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:54.974219 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a54300-7d5e-45c3-8143-a7678e8a74b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:54.975146 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a54300-7d5e-45c3-8143-a7678e8a74b4 None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:54.975587 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a54300-7d5e-45c3-8143-a7678e8a74b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:54.975871 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a54300-7d5e-45c3-8143-a7678e8a74b4 None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:54.976619 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a54300-7d5e-45c3-8143-a7678e8a74b4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:54.976926 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a54300-7d5e-45c3-8143-a7678e8a74b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:54.978311 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a54300-7d5e-45c3-8143-a7678e8a74b4 None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:54.983570 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 655/1299] 10.222.0.24 () {56 vars in 1116 bytes} [Wed May 25 13:44:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:54.989502 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481632d-ec1e-44f7-a244-bb796c4c9f42 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:55.021207 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:55.092337 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481632d-ec1e-44f7-a244-bb796c4c9f42 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:55.126864 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4354f-7c62-422e-bd92-eb7f79bc952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:55.127522 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4354f-7c62-422e-bd92-eb7f79bc952d None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:55.127805 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4354f-7c62-422e-bd92-eb7f79bc952d None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:55.128082 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4354f-7c62-422e-bd92-eb7f79bc952d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:55.128917 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4354f-7c62-422e-bd92-eb7f79bc952d None admin] RBAC: Adding query filter params (interface=public, service_id=8a7d717006df44f6bfbc2fb20416baaa, region_id=RegionOne) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:55.129227 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4354f-7c62-422e-bd92-eb7f79bc952d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:55.131169 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4354f-7c62-422e-bd92-eb7f79bc952d None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:55.137194 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 645/1300] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 13:44:54 2022] GET /identity/v3/endpoints?service_id=8a7d717006df44f6bfbc2fb20416baaa&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:55.143338 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a54300-7d5e-45c3-8143-a7678e8a74b4 None admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:55.257448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:55.278154 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a54300-7d5e-45c3-8143-a7678e8a74b4 None admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:55.314305 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a46f8-fe24-4776-9c27-3811f666288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:55.314967 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a46f8-fe24-4776-9c27-3811f666288c None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:55.315256 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a46f8-fe24-4776-9c27-3811f666288c None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:55.315532 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a46f8-fe24-4776-9c27-3811f666288c None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:55.316250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a46f8-fe24-4776-9c27-3811f666288c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:55.317685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a46f8-fe24-4776-9c27-3811f666288c None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:55.325384 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 656/1301] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 13:44:55 2022] GET /identity/v3/services => generated 2191 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:44:57.577037 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b56d29-667b-43f6-a243-ad6ef2069a59 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:57.577604 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b56d29-667b-43f6-a243-ad6ef2069a59 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:57.577604 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b56d29-667b-43f6-a243-ad6ef2069a59 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:57.579105 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 646/1302] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:57.584835 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0d4a6-3a07-4c24-9e44-95be768862bc None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:57.585565 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0d4a6-3a07-4c24-9e44-95be768862bc None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:57.585565 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0d4a6-3a07-4c24-9e44-95be768862bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:57.603628 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-d6f0d4a6-3a07-4c24-9e44-95be768862bc None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:57.604908 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-d6f0d4a6-3a07-4c24-9e44-95be768862bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:57.685299 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 657/1303] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:44:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:44:57.708542 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b56d29-667b-43f6-a243-ad6ef2069a59 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:57.813649 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:57.821025 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b56d29-667b-43f6-a243-ad6ef2069a59 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:57.856754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a2e00-bb2d-4c10-904d-db2cf5af5d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:57.857459 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a2e00-bb2d-4c10-904d-db2cf5af5d68 None admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:57.857745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a2e00-bb2d-4c10-904d-db2cf5af5d68 None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:57.858024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a2e00-bb2d-4c10-904d-db2cf5af5d68 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:57.858683 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a2e00-bb2d-4c10-904d-db2cf5af5d68 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:57.860076 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a2e00-bb2d-4c10-904d-db2cf5af5d68 None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application [None req-a12a2e00-bb2d-4c10-904d-db2cf5af5d68 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:44:57.872660 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:44:57.873870 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application with Lock( May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self._enter() May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application return self.creator() May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application created_value = creator( May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:44:57.874898 dv-cinder-803823-8-smb devstack@keystone.service[86643]: ERROR keystone.server.flask.application May 25 13:44:57.876279 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 647/1304] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 13:44:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:44:57.880103 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0d4a6-3a07-4c24-9e44-95be768862bc None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:57.958247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:57.985993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0d4a6-3a07-4c24-9e44-95be768862bc None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:58.043267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbf9cc-da6d-4422-af5a-7908d00f241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:58.044502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf9cc-da6d-4422-af5a-7908d00f241f None admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:58.045037 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf9cc-da6d-4422-af5a-7908d00f241f None admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:58.045566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf9cc-da6d-4422-af5a-7908d00f241f None admin] PATH_INFO: `/v3/services` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:58.046985 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbf9cc-da6d-4422-af5a-7908d00f241f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:44:58.047576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbf9cc-da6d-4422-af5a-7908d00f241f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:58.050344 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbf9cc-da6d-4422-af5a-7908d00f241f None admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:58.060435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 658/1305] 10.222.0.24 () {56 vars in 1116 bytes} [Wed May 25 13:44:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:44:58.066286 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a2e00-bb2d-4c10-904d-db2cf5af5d68 None admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:58.177611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a2e00-bb2d-4c10-904d-db2cf5af5d68 None admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:58.211966 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2e5b7-4c8f-437b-8627-770805a31bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:58.212649 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2e5b7-4c8f-437b-8627-770805a31bfa None admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:58.213180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2e5b7-4c8f-437b-8627-770805a31bfa None admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:58.213455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2e5b7-4c8f-437b-8627-770805a31bfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:58.214204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2e5b7-4c8f-437b-8627-770805a31bfa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:58.215554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2e5b7-4c8f-437b-8627-770805a31bfa None admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:58.237368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 648/1306] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 13:44:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:45:08.054239 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=30 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:45:08.232818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:04.793632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071f175-e5a9-4858-a091-1e295d1b5ac5 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:04.794215 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071f175-e5a9-4858-a091-1e295d1b5ac5 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:04.794215 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071f175-e5a9-4858-a091-1e295d1b5ac5 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:04.801642 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2bafd-b73e-4d40-84bc-936f1f3bc72e None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:04.802123 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2bafd-b73e-4d40-84bc-936f1f3bc72e None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:04.802224 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2bafd-b73e-4d40-84bc-936f1f3bc72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:04.804205 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 659/1307] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:46:04.889981 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-5fd2bafd-b73e-4d40-84bc-936f1f3bc72e None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:04.891224 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-5fd2bafd-b73e-4d40-84bc-936f1f3bc72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:05.028969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 649/1308] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:05.072905 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb5f8c-9dad-4b78-a43e-3ae26ea2ea3f None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:05.073222 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb5f8c-9dad-4b78-a43e-3ae26ea2ea3f None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:05.073516 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb5f8c-9dad-4b78-a43e-3ae26ea2ea3f None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:05.075936 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 660/1309] 10.222.0.24 () {54 vars in 964 bytes} [Wed May 25 13:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:05.082735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e910aa-52b6-46a1-9022-8538fe1f61ed None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:05.083107 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e910aa-52b6-46a1-9022-8538fe1f61ed None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:05.083479 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e910aa-52b6-46a1-9022-8538fe1f61ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:05.298159 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-a9e910aa-52b6-46a1-9022-8538fe1f61ed None None] MFA Rules not processed for user `e29f2382dd6f4f648c31f12240ba5793`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:05.299729 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-a9e910aa-52b6-46a1-9022-8538fe1f61ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:05.330280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:05.399962 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 650/1310] 10.222.0.24 () {58 vars in 1061 bytes} [Wed May 25 13:46:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:46:05.409290 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb5f8c-9dad-4b78-a43e-3ae26ea2ea3f None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:05.411090 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-3acb5f8c-9dad-4b78-a43e-3ae26ea2ea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:05.538195 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb5f8c-9dad-4b78-a43e-3ae26ea2ea3f None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:05.639533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c50d4e-8d6c-42d5-81aa-b976a528c7ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:05.640237 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c50d4e-8d6c-42d5-81aa-b976a528c7ed service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:05.640518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c50d4e-8d6c-42d5-81aa-b976a528c7ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:05.640786 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c50d4e-8d6c-42d5-81aa-b976a528c7ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:05.642525 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-50c50d4e-8d6c-42d5-81aa-b976a528c7ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:05.714145 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:05.797754 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c50d4e-8d6c-42d5-81aa-b976a528c7ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:05.800798 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c50d4e-8d6c-42d5-81aa-b976a528c7ed service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:05.837534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 661/1311] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:08.683865 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892603-eb4b-4f92-aaed-037cc03d304b None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:08.684555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892603-eb4b-4f92-aaed-037cc03d304b None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:08.684555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892603-eb4b-4f92-aaed-037cc03d304b None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:08.685985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 651/1312] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:08.691477 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01be36-5818-401c-9f3d-4254262a0c45 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:08.691998 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01be36-5818-401c-9f3d-4254262a0c45 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:08.692299 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01be36-5818-401c-9f3d-4254262a0c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:08.767253 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-be01be36-5818-401c-9f3d-4254262a0c45 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:08.768501 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-be01be36-5818-401c-9f3d-4254262a0c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:08.874894 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 662/1313] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:08.914813 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63892603-eb4b-4f92-aaed-037cc03d304b None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:08.916553 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-63892603-eb4b-4f92-aaed-037cc03d304b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:09.057633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63892603-eb4b-4f92-aaed-037cc03d304b None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:09.165338 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:09.168478 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baf3c9-078b-46dd-804e-4fb53c8050ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:09.169462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baf3c9-078b-46dd-804e-4fb53c8050ed service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:09.170129 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baf3c9-078b-46dd-804e-4fb53c8050ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:09.170672 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baf3c9-078b-46dd-804e-4fb53c8050ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:09.172922 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-33baf3c9-078b-46dd-804e-4fb53c8050ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:09.299400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33baf3c9-078b-46dd-804e-4fb53c8050ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:09.302311 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33baf3c9-078b-46dd-804e-4fb53c8050ed service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:09.324378 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 652/1314] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:11.900735 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc63b14-e9c7-4ded-b887-aa05e55a51a0 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:11.901272 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc63b14-e9c7-4ded-b887-aa05e55a51a0 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:11.901272 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc63b14-e9c7-4ded-b887-aa05e55a51a0 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:11.902715 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 663/1315] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:11.907996 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c59a7-783e-4baa-baf7-1e8846e322d8 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:11.908435 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c59a7-783e-4baa-baf7-1e8846e322d8 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:11.908857 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c59a7-783e-4baa-baf7-1e8846e322d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:11.974454 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-c78c59a7-783e-4baa-baf7-1e8846e322d8 None None] MFA Rules not processed for user `688440bc9b9f4620b021702bf9982c66`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:11.975623 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-c78c59a7-783e-4baa-baf7-1e8846e322d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:12.028353 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:12.081514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 653/1316] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:12.135128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91906b1-59cc-46e7-a7d8-ec544251e7f8 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:12.135517 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91906b1-59cc-46e7-a7d8-ec544251e7f8 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:12.135832 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91906b1-59cc-46e7-a7d8-ec544251e7f8 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:12.137295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 664/1317] 10.222.0.24 () {54 vars in 964 bytes} [Wed May 25 13:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:12.143053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e442b4-9537-4f9a-8d01-eb5c86152d1f None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:12.143346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e442b4-9537-4f9a-8d01-eb5c86152d1f None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:12.143626 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e442b4-9537-4f9a-8d01-eb5c86152d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:12.222965 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-10e442b4-9537-4f9a-8d01-eb5c86152d1f None None] MFA Rules not processed for user `e29f2382dd6f4f648c31f12240ba5793`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:12.224246 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-10e442b4-9537-4f9a-8d01-eb5c86152d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:12.300045 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 654/1318] 10.222.0.24 () {58 vars in 1061 bytes} [Wed May 25 13:46:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:12.309331 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91906b1-59cc-46e7-a7d8-ec544251e7f8 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:12.310890 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-f91906b1-59cc-46e7-a7d8-ec544251e7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:12.321614 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:12.430744 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91906b1-59cc-46e7-a7d8-ec544251e7f8 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:12.506121 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de21d82-4067-4c84-b108-1c00ee9541cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:12.506834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21d82-4067-4c84-b108-1c00ee9541cb service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:12.507123 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21d82-4067-4c84-b108-1c00ee9541cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:12.507396 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21d82-4067-4c84-b108-1c00ee9541cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:12.509146 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-3de21d82-4067-4c84-b108-1c00ee9541cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:12.571343 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:12.619693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de21d82-4067-4c84-b108-1c00ee9541cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:12.621184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de21d82-4067-4c84-b108-1c00ee9541cb service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:12.640733 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 665/1319] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:15.861080 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c5985-2697-4abc-96c6-5f7e10c3128b None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:15.861710 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c5985-2697-4abc-96c6-5f7e10c3128b None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:15.861710 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c5985-2697-4abc-96c6-5f7e10c3128b None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:15.863029 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 655/1320] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:15.869073 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822d795-5a3c-4478-bb59-81ffa7eb9d6a None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:15.869510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822d795-5a3c-4478-bb59-81ffa7eb9d6a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:15.869640 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822d795-5a3c-4478-bb59-81ffa7eb9d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:15.937265 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-d822d795-5a3c-4478-bb59-81ffa7eb9d6a None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:15.938498 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-d822d795-5a3c-4478-bb59-81ffa7eb9d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:16.032689 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 666/1321] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:16.072931 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c5985-2697-4abc-96c6-5f7e10c3128b None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:16.074498 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-214c5985-2697-4abc-96c6-5f7e10c3128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:16.126052 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:16.182385 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c5985-2697-4abc-96c6-5f7e10c3128b None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:16.255771 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9913c00-dcc9-4509-81f5-15061f6b9ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:16.256456 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9913c00-dcc9-4509-81f5-15061f6b9ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:16.256736 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9913c00-dcc9-4509-81f5-15061f6b9ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:16.257012 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9913c00-dcc9-4509-81f5-15061f6b9ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:16.258678 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-e9913c00-dcc9-4509-81f5-15061f6b9ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:16.356168 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:16.369995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9913c00-dcc9-4509-81f5-15061f6b9ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:16.371468 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9913c00-dcc9-4509-81f5-15061f6b9ee7 service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:16.389848 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 656/1322] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:19.358758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14028-47bf-4330-ba9e-3fde9dec9bac None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:19.359420 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14028-47bf-4330-ba9e-3fde9dec9bac None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:19.359420 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14028-47bf-4330-ba9e-3fde9dec9bac None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:19.360889 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 667/1323] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:19.366916 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b730d-e62b-4893-91c0-69d748e01db4 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:19.367346 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b730d-e62b-4893-91c0-69d748e01db4 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:19.367555 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b730d-e62b-4893-91c0-69d748e01db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:19.446393 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-c98b730d-e62b-4893-91c0-69d748e01db4 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:19.447653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-c98b730d-e62b-4893-91c0-69d748e01db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:19.552009 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 657/1324] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:19.589086 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14028-47bf-4330-ba9e-3fde9dec9bac None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:19.590890 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-abe14028-47bf-4330-ba9e-3fde9dec9bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:19.610903 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:19.708518 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14028-47bf-4330-ba9e-3fde9dec9bac None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:19.798395 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828030a-97e9-4247-89ac-2e8c2c66534d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:19.799056 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828030a-97e9-4247-89ac-2e8c2c66534d service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:19.799344 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828030a-97e9-4247-89ac-2e8c2c66534d service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:19.799622 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828030a-97e9-4247-89ac-2e8c2c66534d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:19.801891 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-a828030a-97e9-4247-89ac-2e8c2c66534d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:19.877091 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:19.918402 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828030a-97e9-4247-89ac-2e8c2c66534d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:19.919867 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828030a-97e9-4247-89ac-2e8c2c66534d service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:19.939109 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 668/1325] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:22.368612 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b373d0a-5ae3-4345-ba75-bd88c31f7433 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:22.369223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b373d0a-5ae3-4345-ba75-bd88c31f7433 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:22.369223 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b373d0a-5ae3-4345-ba75-bd88c31f7433 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:22.370528 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 658/1326] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:22.375973 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb861c7-b33b-47fa-a66e-c873f31fb49b None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:22.376461 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb861c7-b33b-47fa-a66e-c873f31fb49b None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:22.376568 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb861c7-b33b-47fa-a66e-c873f31fb49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:22.445363 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-0bb861c7-b33b-47fa-a66e-c873f31fb49b None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:22.446604 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-0bb861c7-b33b-47fa-a66e-c873f31fb49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:22.544824 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 669/1327] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:22.580776 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b373d0a-5ae3-4345-ba75-bd88c31f7433 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:22.583110 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-9b373d0a-5ae3-4345-ba75-bd88c31f7433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:22.647748 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:22.692737 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b373d0a-5ae3-4345-ba75-bd88c31f7433 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:22.771800 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e417c-3131-407f-b44d-cea2fdd9a407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:22.772507 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e417c-3131-407f-b44d-cea2fdd9a407 service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:22.772796 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e417c-3131-407f-b44d-cea2fdd9a407 service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:22.773078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e417c-3131-407f-b44d-cea2fdd9a407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:22.774747 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-029e417c-3131-407f-b44d-cea2fdd9a407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:22.884825 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:22.888318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e417c-3131-407f-b44d-cea2fdd9a407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:22.890162 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e417c-3131-407f-b44d-cea2fdd9a407 service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:22.911714 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 659/1328] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:25.240927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34f41e-0b46-419f-860f-00aa8d5fafc3 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:25.241472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34f41e-0b46-419f-860f-00aa8d5fafc3 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:25.241472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34f41e-0b46-419f-860f-00aa8d5fafc3 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:25.242873 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 670/1329] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:25.248752 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d16b87-2a80-4911-91c8-d1d8fd5e7129 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:25.249480 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d16b87-2a80-4911-91c8-d1d8fd5e7129 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:25.249480 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d16b87-2a80-4911-91c8-d1d8fd5e7129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:25.323817 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-22d16b87-2a80-4911-91c8-d1d8fd5e7129 None None] MFA Rules not processed for user `688440bc9b9f4620b021702bf9982c66`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:25.325068 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-22d16b87-2a80-4911-91c8-d1d8fd5e7129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:25.425745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 660/1330] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:25.464214 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34f41e-0b46-419f-860f-00aa8d5fafc3 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:25.466490 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-3c34f41e-0b46-419f-860f-00aa8d5fafc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:25.498621 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:25.575478 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34f41e-0b46-419f-860f-00aa8d5fafc3 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:25.653974 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579d2b1-d790-4d06-8540-3c440f29081f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:25.654585 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579d2b1-d790-4d06-8540-3c440f29081f service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:25.654872 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579d2b1-d790-4d06-8540-3c440f29081f service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:25.655149 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579d2b1-d790-4d06-8540-3c440f29081f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:25.656853 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-e579d2b1-d790-4d06-8540-3c440f29081f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:25.739913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:25.774039 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579d2b1-d790-4d06-8540-3c440f29081f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:25.775425 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579d2b1-d790-4d06-8540-3c440f29081f service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:25.797924 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 671/1331] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:28.360447 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b896-7ba6-4c39-a1c5-d7cbdfbe47e8 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:28.360967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b896-7ba6-4c39-a1c5-d7cbdfbe47e8 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:28.360967 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b896-7ba6-4c39-a1c5-d7cbdfbe47e8 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:28.362281 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 661/1332] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:28.368555 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf99c8-d4fa-4911-abd2-ad2189713bc2 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:28.369045 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf99c8-d4fa-4911-abd2-ad2189713bc2 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:28.369168 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf99c8-d4fa-4911-abd2-ad2189713bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:28.441428 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-38cf99c8-d4fa-4911-abd2-ad2189713bc2 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:28.443291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-38cf99c8-d4fa-4911-abd2-ad2189713bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:28.544001 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 672/1333] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:28.580526 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41b896-7ba6-4c39-a1c5-d7cbdfbe47e8 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:28.582064 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-3b41b896-7ba6-4c39-a1c5-d7cbdfbe47e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:28.655737 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:28.697971 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41b896-7ba6-4c39-a1c5-d7cbdfbe47e8 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:28.782567 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507f5e4-ae63-4bfe-86fe-2d979bb45576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:28.783513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507f5e4-ae63-4bfe-86fe-2d979bb45576 service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:28.783800 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507f5e4-ae63-4bfe-86fe-2d979bb45576 service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:28.784081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507f5e4-ae63-4bfe-86fe-2d979bb45576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:28.786830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-8507f5e4-ae63-4bfe-86fe-2d979bb45576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:28.929246 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507f5e4-ae63-4bfe-86fe-2d979bb45576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:28.930706 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507f5e4-ae63-4bfe-86fe-2d979bb45576 service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:28.942657 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:28.952648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 662/1334] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:31.268957 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b2b5-aa00-42bf-9227-38267d3daf57 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:31.269502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b2b5-aa00-42bf-9227-38267d3daf57 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:31.269502 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b2b5-aa00-42bf-9227-38267d3daf57 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:31.271078 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 673/1335] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:46:31.276417 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a59fc-3549-4c12-9a38-dc70fd00f08d None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:31.276852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a59fc-3549-4c12-9a38-dc70fd00f08d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:31.276979 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a59fc-3549-4c12-9a38-dc70fd00f08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:31.342663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-e42a59fc-3549-4c12-9a38-dc70fd00f08d None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:31.343884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-e42a59fc-3549-4c12-9a38-dc70fd00f08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:31.439078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 663/1336] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:31.480153 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b2b5-aa00-42bf-9227-38267d3daf57 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:31.481723 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-1f24b2b5-aa00-42bf-9227-38267d3daf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:31.524925 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:31.589848 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b2b5-aa00-42bf-9227-38267d3daf57 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:31.665657 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38228c23-80b1-43bb-acee-212f732dcf76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:31.666317 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38228c23-80b1-43bb-acee-212f732dcf76 service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:31.666601 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38228c23-80b1-43bb-acee-212f732dcf76 service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:31.666878 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38228c23-80b1-43bb-acee-212f732dcf76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:31.668612 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-38228c23-80b1-43bb-acee-212f732dcf76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:31.760674 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:31.793882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38228c23-80b1-43bb-acee-212f732dcf76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:31.795272 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38228c23-80b1-43bb-acee-212f732dcf76 service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:31.815131 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 674/1337] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:34.430426 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a86e5-6c03-4de2-a373-49ab8bd37b75 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:34.431084 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a86e5-6c03-4de2-a373-49ab8bd37b75 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:34.431084 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a86e5-6c03-4de2-a373-49ab8bd37b75 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:34.432504 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 664/1338] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:34.437807 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b90f98-ce3f-454d-bb8f-06faf1443b60 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:34.438211 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b90f98-ce3f-454d-bb8f-06faf1443b60 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:34.438367 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b90f98-ce3f-454d-bb8f-06faf1443b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:34.506490 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-61b90f98-ce3f-454d-bb8f-06faf1443b60 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:34.507805 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-61b90f98-ce3f-454d-bb8f-06faf1443b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:34.605910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 675/1339] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:34.642299 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a86e5-6c03-4de2-a373-49ab8bd37b75 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:34.643868 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-638a86e5-6c03-4de2-a373-49ab8bd37b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:34.721876 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:34.754869 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a86e5-6c03-4de2-a373-49ab8bd37b75 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:34.845799 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73e809-8597-4f2f-b997-b8e136f18310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:34.846486 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73e809-8597-4f2f-b997-b8e136f18310 service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:34.846770 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73e809-8597-4f2f-b997-b8e136f18310 service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:34.847046 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73e809-8597-4f2f-b997-b8e136f18310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:34.850249 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-3a73e809-8597-4f2f-b997-b8e136f18310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:35.002491 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73e809-8597-4f2f-b997-b8e136f18310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:35.003845 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73e809-8597-4f2f-b997-b8e136f18310 service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:35.030554 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 665/1340] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:39.426266 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d1fa-f0d7-43c0-b73a-95e7f3c051c1 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:39.427068 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d1fa-f0d7-43c0-b73a-95e7f3c051c1 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:39.427068 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d1fa-f0d7-43c0-b73a-95e7f3c051c1 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:39.428347 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 676/1341] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:39.435141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0e596-b604-4e94-9890-9c128e12241f None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:39.435693 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0e596-b604-4e94-9890-9c128e12241f None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:39.435693 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0e596-b604-4e94-9890-9c128e12241f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:39.445792 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=100 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:39.516736 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-f8f0e596-b604-4e94-9890-9c128e12241f None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:39.517887 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-f8f0e596-b604-4e94-9890-9c128e12241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:39.626222 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 666/1342] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:46:39.666293 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d1fa-f0d7-43c0-b73a-95e7f3c051c1 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:39.668575 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-edd1d1fa-f0d7-43c0-b73a-95e7f3c051c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:39.725725 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:39.795616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d1fa-f0d7-43c0-b73a-95e7f3c051c1 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:39.800192 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee4ca1-1bae-4b2d-9807-63d8fcfabf51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:39.800864 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee4ca1-1bae-4b2d-9807-63d8fcfabf51 service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:39.801150 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee4ca1-1bae-4b2d-9807-63d8fcfabf51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:39.801425 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee4ca1-1bae-4b2d-9807-63d8fcfabf51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:39.812345 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee4ca1-1bae-4b2d-9807-63d8fcfabf51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:39.813838 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee4ca1-1bae-4b2d-9807-63d8fcfabf51 service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:39.825156 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 677/1343] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:46:42.765457 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250dfa0-3eee-4d69-92b4-8fea0bf014bc None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:42.765863 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250dfa0-3eee-4d69-92b4-8fea0bf014bc None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:42.765863 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250dfa0-3eee-4d69-92b4-8fea0bf014bc None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:42.767646 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 667/1344] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:42.773402 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c4e2e-6725-4d50-a332-c022c1711cec None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:42.773909 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c4e2e-6725-4d50-a332-c022c1711cec None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:42.774013 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c4e2e-6725-4d50-a332-c022c1711cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:42.815132 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-f89c4e2e-6725-4d50-a332-c022c1711cec None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:42.816779 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-f89c4e2e-6725-4d50-a332-c022c1711cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:42.910559 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 678/1345] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:42.953509 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250dfa0-3eee-4d69-92b4-8fea0bf014bc None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:42.966283 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250dfa0-3eee-4d69-92b4-8fea0bf014bc None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:42.970634 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf590-4e9a-4f3c-9c9f-f6f4952dafa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:42.971314 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf590-4e9a-4f3c-9c9f-f6f4952dafa4 service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:42.971598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf590-4e9a-4f3c-9c9f-f6f4952dafa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:42.971872 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf590-4e9a-4f3c-9c9f-f6f4952dafa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:42.984175 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaf590-4e9a-4f3c-9c9f-f6f4952dafa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:42.991387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaf590-4e9a-4f3c-9c9f-f6f4952dafa4 service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:43.003427 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 668/1346] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:47.559731 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efbe84-170e-4c9a-b373-b1048de6c366 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:47.560294 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efbe84-170e-4c9a-b373-b1048de6c366 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:47.560294 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efbe84-170e-4c9a-b373-b1048de6c366 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:47.561670 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 679/1347] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:47.567004 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3fc6e-66cb-4d29-a7b6-298d81eea6eb None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:47.567459 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3fc6e-66cb-4d29-a7b6-298d81eea6eb None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:47.567838 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3fc6e-66cb-4d29-a7b6-298d81eea6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:47.587081 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-62f3fc6e-66cb-4d29-a7b6-298d81eea6eb None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:47.588663 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-62f3fc6e-66cb-4d29-a7b6-298d81eea6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:47.597073 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 669/1348] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:47.636099 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efbe84-170e-4c9a-b373-b1048de6c366 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:47.647920 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efbe84-170e-4c9a-b373-b1048de6c366 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:47.651748 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279c759-65f0-4faf-b490-267d99216d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:47.652424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279c759-65f0-4faf-b490-267d99216d1d service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:47.652709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279c759-65f0-4faf-b490-267d99216d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:47.652987 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279c759-65f0-4faf-b490-267d99216d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:47.664557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279c759-65f0-4faf-b490-267d99216d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:47.667297 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279c759-65f0-4faf-b490-267d99216d1d service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:47.677260 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 680/1349] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:46:53.262024 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d42d7-1f32-4986-a46c-79e748f3f8d6 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:53.262595 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d42d7-1f32-4986-a46c-79e748f3f8d6 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:53.262595 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d42d7-1f32-4986-a46c-79e748f3f8d6 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:53.263963 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 670/1350] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 13:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:53.269424 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00b12-5e4c-4fcb-9f9f-f2d1ca3054af None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:53.269903 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00b12-5e4c-4fcb-9f9f-f2d1ca3054af None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:53.270022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00b12-5e4c-4fcb-9f9f-f2d1ca3054af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:53.362984 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-0dd00b12-5e4c-4fcb-9f9f-f2d1ca3054af None None] MFA Rules not processed for user `9e134a7b368941eeb7223beb5b40c36a`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:53.364329 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-0dd00b12-5e4c-4fcb-9f9f-f2d1ca3054af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:53.420236 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:53.507057 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 681/1351] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:57.580878 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=72 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:57.815306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659ae1b-1f58-44a4-8b03-b71bf551e636 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:57.815782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659ae1b-1f58-44a4-8b03-b71bf551e636 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:57.816191 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659ae1b-1f58-44a4-8b03-b71bf551e636 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:57.818463 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 671/1352] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 13:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:57.823533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb6127-3d83-4567-bc8c-0b791a622bb8 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:57.824020 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb6127-3d83-4567-bc8c-0b791a622bb8 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:57.824133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb6127-3d83-4567-bc8c-0b791a622bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:57.843686 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-98bb6127-3d83-4567-bc8c-0b791a622bb8 None None] MFA Rules not processed for user `9e134a7b368941eeb7223beb5b40c36a`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:57.844927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-98bb6127-3d83-4567-bc8c-0b791a622bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:57.855001 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 682/1353] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:59.460188 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37743ed1-a1b7-4cac-b825-011daecfa060 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:59.460722 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37743ed1-a1b7-4cac-b825-011daecfa060 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:59.460832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37743ed1-a1b7-4cac-b825-011daecfa060 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:59.462360 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 672/1354] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 13:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:59.467896 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7ae11-e141-4191-b292-5a1e941321aa None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:59.468392 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7ae11-e141-4191-b292-5a1e941321aa None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:59.468489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7ae11-e141-4191-b292-5a1e941321aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:59.487713 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-c3c7ae11-e141-4191-b292-5a1e941321aa None None] MFA Rules not processed for user `9e134a7b368941eeb7223beb5b40c36a`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:59.488986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-c3c7ae11-e141-4191-b292-5a1e941321aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:59.497747 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 683/1355] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 13:46:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:03.421656 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c420b2-e209-499a-a9bc-ef24bcd9ed1e None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:03.422189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c420b2-e209-499a-a9bc-ef24bcd9ed1e None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:03.422189 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c420b2-e209-499a-a9bc-ef24bcd9ed1e None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:03.424254 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 673/1356] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:03.429714 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb54aa-402b-4abf-bd15-17b2df28ab42 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:03.430267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb54aa-402b-4abf-bd15-17b2df28ab42 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:03.430267 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb54aa-402b-4abf-bd15-17b2df28ab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:03.450783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-c0bb54aa-402b-4abf-bd15-17b2df28ab42 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:03.452015 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-c0bb54aa-402b-4abf-bd15-17b2df28ab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:03.461096 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 684/1357] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:47:03.522087 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e560d8-b226-43b1-a619-eb14313f345a None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:03.522384 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e560d8-b226-43b1-a619-eb14313f345a None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:03.522948 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e560d8-b226-43b1-a619-eb14313f345a None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:03.525970 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 674/1358] 10.222.0.24 () {54 vars in 961 bytes} [Wed May 25 13:47:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:03.534983 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a185f2-a05f-4952-8832-5de774a45f0a None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:03.535343 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a185f2-a05f-4952-8832-5de774a45f0a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:03.535586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a185f2-a05f-4952-8832-5de774a45f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:03.601539 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-37a185f2-a05f-4952-8832-5de774a45f0a None None] MFA Rules not processed for user `971eae8a8ad44ce893c311b74acbd76b`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:03.602774 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-37a185f2-a05f-4952-8832-5de774a45f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:03.700247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 685/1359] 10.222.0.24 () {58 vars in 1058 bytes} [Wed May 25 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:03.709795 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e560d8-b226-43b1-a619-eb14313f345a None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:03.736745 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e560d8-b226-43b1-a619-eb14313f345a None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:03.743883 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8e87d-5eaa-4bec-84b8-a50b8dfa4c9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:03.744613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8e87d-5eaa-4bec-84b8-a50b8dfa4c9f service nova] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:03.744934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8e87d-5eaa-4bec-84b8-a50b8dfa4c9f service nova] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:03.745392 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8e87d-5eaa-4bec-84b8-a50b8dfa4c9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:03.755372 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8e87d-5eaa-4bec-84b8-a50b8dfa4c9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:03.757395 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8e87d-5eaa-4bec-84b8-a50b8dfa4c9f service nova] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:03.768294 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 675/1360] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:06.271767 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f968b21-7b84-4620-a696-d3fc6bdff838 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:06.272422 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f968b21-7b84-4620-a696-d3fc6bdff838 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:06.272636 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f968b21-7b84-4620-a696-d3fc6bdff838 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:06.274199 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 686/1361] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:06.280831 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4db72-41bf-4d2a-b3c7-974b8acbca57 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:06.281318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4db72-41bf-4d2a-b3c7-974b8acbca57 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:06.281318 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4db72-41bf-4d2a-b3c7-974b8acbca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:06.300322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-0ff4db72-41bf-4d2a-b3c7-974b8acbca57 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:06.301545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-0ff4db72-41bf-4d2a-b3c7-974b8acbca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:06.310257 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 676/1362] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:06.358932 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f968b21-7b84-4620-a696-d3fc6bdff838 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:06.377675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f968b21-7b84-4620-a696-d3fc6bdff838 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:06.383706 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db8191-a4d5-40da-9951-976748bcc2f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:06.384393 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8191-a4d5-40da-9951-976748bcc2f1 service nova] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:06.384682 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8191-a4d5-40da-9951-976748bcc2f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:06.384955 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8191-a4d5-40da-9951-976748bcc2f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:06.394617 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db8191-a4d5-40da-9951-976748bcc2f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:06.396849 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db8191-a4d5-40da-9951-976748bcc2f1 service nova] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:06.406983 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 687/1363] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:09.166049 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e88fd-77fd-4eec-b532-b034215d6972 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:09.166592 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e88fd-77fd-4eec-b532-b034215d6972 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:09.166592 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e88fd-77fd-4eec-b532-b034215d6972 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:09.167985 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 677/1364] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:09.173731 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cab34-c877-4a83-8deb-b8e52513d10c None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:09.174207 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cab34-c877-4a83-8deb-b8e52513d10c None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:09.174306 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cab34-c877-4a83-8deb-b8e52513d10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:09.194419 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-bf6cab34-c877-4a83-8deb-b8e52513d10c None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:09.195656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-bf6cab34-c877-4a83-8deb-b8e52513d10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:09.204054 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 688/1365] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:09.258021 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09441332-886e-4818-acdb-2d91b0aeafed None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:09.258477 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09441332-886e-4818-acdb-2d91b0aeafed None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:09.258920 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09441332-886e-4818-acdb-2d91b0aeafed None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:09.260361 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 678/1366] 10.222.0.24 () {54 vars in 961 bytes} [Wed May 25 13:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:47:09.266112 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b25ff8-c914-4c02-8bd9-c66821b96301 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:09.267320 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b25ff8-c914-4c02-8bd9-c66821b96301 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:09.267320 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b25ff8-c914-4c02-8bd9-c66821b96301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:09.288577 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-57b25ff8-c914-4c02-8bd9-c66821b96301 None None] MFA Rules not processed for user `971eae8a8ad44ce893c311b74acbd76b`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:09.289907 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-57b25ff8-c914-4c02-8bd9-c66821b96301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:09.302388 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 689/1367] 10.222.0.24 () {58 vars in 1058 bytes} [Wed May 25 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:47:09.310528 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09441332-886e-4818-acdb-2d91b0aeafed None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:09.326344 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09441332-886e-4818-acdb-2d91b0aeafed None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:09.335113 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac71f0b-e571-4a11-80b0-b36f627bcb41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:09.335113 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac71f0b-e571-4a11-80b0-b36f627bcb41 service nova] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:09.335113 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac71f0b-e571-4a11-80b0-b36f627bcb41 service nova] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:09.335113 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac71f0b-e571-4a11-80b0-b36f627bcb41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:09.346405 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac71f0b-e571-4a11-80b0-b36f627bcb41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:09.348185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac71f0b-e571-4a11-80b0-b36f627bcb41 service nova] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:09.367312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 679/1368] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:11.744814 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29ad42-d9bb-4754-b9c9-8da4a4029343 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:11.745371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29ad42-d9bb-4754-b9c9-8da4a4029343 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:11.745371 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29ad42-d9bb-4754-b9c9-8da4a4029343 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:11.746768 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 690/1369] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:11.752406 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0b954-5b6d-4da9-9e89-4918951e7741 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:11.752860 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0b954-5b6d-4da9-9e89-4918951e7741 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:11.752955 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0b954-5b6d-4da9-9e89-4918951e7741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:11.772186 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-08b0b954-5b6d-4da9-9e89-4918951e7741 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:11.773404 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-08b0b954-5b6d-4da9-9e89-4918951e7741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:11.781577 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 680/1370] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:11.826557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29ad42-d9bb-4754-b9c9-8da4a4029343 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:11.842069 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29ad42-d9bb-4754-b9c9-8da4a4029343 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:11.848146 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4770b-bd30-425c-8a44-76e89f909069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:11.849011 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4770b-bd30-425c-8a44-76e89f909069 service nova] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:11.849528 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4770b-bd30-425c-8a44-76e89f909069 service nova] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:11.850022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4770b-bd30-425c-8a44-76e89f909069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:11.859359 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4770b-bd30-425c-8a44-76e89f909069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:11.861209 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4770b-bd30-425c-8a44-76e89f909069 service nova] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:11.872656 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 691/1371] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:12.088517 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f47e10-01a0-418c-ae09-353a65c96f6d None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:12.088727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f47e10-01a0-418c-ae09-353a65c96f6d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:12.088983 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f47e10-01a0-418c-ae09-353a65c96f6d None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:12.090596 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 681/1372] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:12.096946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9a589-db98-4385-a267-b60df118a636 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:12.097273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9a589-db98-4385-a267-b60df118a636 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:12.097557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9a589-db98-4385-a267-b60df118a636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:12.120859 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-27b9a589-db98-4385-a267-b60df118a636 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:12.122342 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-27b9a589-db98-4385-a267-b60df118a636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:12.131770 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 692/1373] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:12.420315 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d5755-897b-45ec-9a55-397f4332de8b None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:12.420559 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d5755-897b-45ec-9a55-397f4332de8b None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:12.421083 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d5755-897b-45ec-9a55-397f4332de8b None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:12.422587 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 682/1374] 10.222.0.24 () {54 vars in 963 bytes} [Wed May 25 13:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:12.428584 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746ec37-25fe-4c50-af7f-df8c3681fcad None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:12.428877 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746ec37-25fe-4c50-af7f-df8c3681fcad None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:12.429145 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746ec37-25fe-4c50-af7f-df8c3681fcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:12.455199 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:47:12.485312 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-d746ec37-25fe-4c50-af7f-df8c3681fcad None None] MFA Rules not processed for user `ac053a5b34cb4fd8a4fb8b0dfa80e922`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:12.486662 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-d746ec37-25fe-4c50-af7f-df8c3681fcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:12.553358 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 693/1375] 10.222.0.24 () {58 vars in 1060 bytes} [Wed May 25 13:47:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:12.561062 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d5755-897b-45ec-9a55-397f4332de8b None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:12.573556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d5755-897b-45ec-9a55-397f4332de8b None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:12.577462 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa19f5-4e34-454a-85a5-f28b77fbc8ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac053a5b34cb4fd8a4fb8b0dfa80e922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:12.578536 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa19f5-4e34-454a-85a5-f28b77fbc8ab service cinder] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:12.579023 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa19f5-4e34-454a-85a5-f28b77fbc8ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:12.579522 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa19f5-4e34-454a-85a5-f28b77fbc8ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:12.590505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa19f5-4e34-454a-85a5-f28b77fbc8ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:12.592467 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa19f5-4e34-454a-85a5-f28b77fbc8ab service cinder] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:12.604071 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 683/1376] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:14.198566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b900d-4686-4b95-84d5-91a28aaa4f43 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:14.199122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b900d-4686-4b95-84d5-91a28aaa4f43 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:14.199122 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b900d-4686-4b95-84d5-91a28aaa4f43 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:14.202104 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 694/1377] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:14.206568 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b673ce-538a-45b3-b1fd-6cc6793f0039 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:14.207186 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b673ce-538a-45b3-b1fd-6cc6793f0039 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:14.207186 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b673ce-538a-45b3-b1fd-6cc6793f0039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:14.227501 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-59b673ce-538a-45b3-b1fd-6cc6793f0039 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:14.228809 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-59b673ce-538a-45b3-b1fd-6cc6793f0039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:14.237048 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 684/1378] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:14.287032 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b900d-4686-4b95-84d5-91a28aaa4f43 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:14.305944 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b900d-4686-4b95-84d5-91a28aaa4f43 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:14.312510 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eb172-248c-4380-986e-ca5ddc17a2d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:14.313306 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eb172-248c-4380-986e-ca5ddc17a2d1 service nova] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:14.313671 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eb172-248c-4380-986e-ca5ddc17a2d1 service nova] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:14.314028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eb172-248c-4380-986e-ca5ddc17a2d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:14.324764 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eb172-248c-4380-986e-ca5ddc17a2d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:14.326438 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eb172-248c-4380-986e-ca5ddc17a2d1 service nova] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:14.338159 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 695/1379] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:16.668940 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdc32f-52e4-4a32-9573-e835e4ca8b52 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:16.669508 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdc32f-52e4-4a32-9573-e835e4ca8b52 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:16.669688 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdc32f-52e4-4a32-9573-e835e4ca8b52 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:16.671312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 685/1380] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:47:16.676910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3eaea-4238-46c6-a021-45475005580c None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:16.677407 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3eaea-4238-46c6-a021-45475005580c None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:16.678116 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3eaea-4238-46c6-a021-45475005580c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:16.700497 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-04c3eaea-4238-46c6-a021-45475005580c None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:16.701709 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-04c3eaea-4238-46c6-a021-45475005580c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:16.711041 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 696/1381] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:16.756185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdc32f-52e4-4a32-9573-e835e4ca8b52 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:16.772777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdc32f-52e4-4a32-9573-e835e4ca8b52 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:16.778599 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacbab5-b2ff-432c-bf9b-6b6501c0ed81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:16.779252 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacbab5-b2ff-432c-bf9b-6b6501c0ed81 service nova] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:16.779538 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacbab5-b2ff-432c-bf9b-6b6501c0ed81 service nova] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:16.779819 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacbab5-b2ff-432c-bf9b-6b6501c0ed81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:16.789876 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacbab5-b2ff-432c-bf9b-6b6501c0ed81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:16.791506 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacbab5-b2ff-432c-bf9b-6b6501c0ed81 service nova] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:16.801934 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 686/1382] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:19.145813 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f843e-a319-45c0-803a-abe230893212 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:19.147006 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f843e-a319-45c0-803a-abe230893212 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:19.147198 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f843e-a319-45c0-803a-abe230893212 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:19.148822 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 697/1383] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:19.154292 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87f40b-9f3a-4dab-b947-00dfaba94037 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:19.154772 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87f40b-9f3a-4dab-b947-00dfaba94037 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:19.154896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87f40b-9f3a-4dab-b947-00dfaba94037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:19.174116 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-3f87f40b-9f3a-4dab-b947-00dfaba94037 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:19.175353 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-3f87f40b-9f3a-4dab-b947-00dfaba94037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:19.186300 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 687/1384] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:19.230505 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f843e-a319-45c0-803a-abe230893212 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:19.248623 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f843e-a319-45c0-803a-abe230893212 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:19.255419 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796595f5-f5e1-40db-9159-46c5b21d9b2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:19.256698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796595f5-f5e1-40db-9159-46c5b21d9b2e service nova] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:19.256986 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796595f5-f5e1-40db-9159-46c5b21d9b2e service nova] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:19.257281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796595f5-f5e1-40db-9159-46c5b21d9b2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:19.267375 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796595f5-f5e1-40db-9159-46c5b21d9b2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:19.269036 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796595f5-f5e1-40db-9159-46c5b21d9b2e service nova] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:19.280169 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 698/1385] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:21.531176 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353b41e-396b-460d-af8b-714580e5111c None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:21.531728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353b41e-396b-460d-af8b-714580e5111c None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:21.531728 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353b41e-396b-460d-af8b-714580e5111c None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:21.533310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 688/1386] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:21.539109 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffad65-686f-4e47-afe0-1c105aa9eb5c None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:21.539584 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffad65-686f-4e47-afe0-1c105aa9eb5c None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:21.539678 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffad65-686f-4e47-afe0-1c105aa9eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:21.560333 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-a3ffad65-686f-4e47-afe0-1c105aa9eb5c None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:21.562034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-a3ffad65-686f-4e47-afe0-1c105aa9eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:21.573435 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 699/1387] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:21.619782 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353b41e-396b-460d-af8b-714580e5111c None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:21.639699 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353b41e-396b-460d-af8b-714580e5111c None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:21.647394 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114cd9c-f3cd-479a-a306-d3605ca5ea39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:21.648340 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114cd9c-f3cd-479a-a306-d3605ca5ea39 service nova] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:21.648794 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114cd9c-f3cd-479a-a306-d3605ca5ea39 service nova] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:21.649152 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114cd9c-f3cd-479a-a306-d3605ca5ea39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:21.660608 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114cd9c-f3cd-479a-a306-d3605ca5ea39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:21.663923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114cd9c-f3cd-479a-a306-d3605ca5ea39 service nova] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:21.676628 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 689/1388] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:23.995236 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9eb12-0a67-4c4c-8327-fe82a587af8d None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:23.995834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9eb12-0a67-4c4c-8327-fe82a587af8d None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:23.995998 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9eb12-0a67-4c4c-8327-fe82a587af8d None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:23.997937 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 700/1389] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:24.005154 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e53e8-c84e-4b00-a7ea-10500ae51f92 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:24.006212 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e53e8-c84e-4b00-a7ea-10500ae51f92 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:24.006372 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e53e8-c84e-4b00-a7ea-10500ae51f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:24.026431 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-b44e53e8-c84e-4b00-a7ea-10500ae51f92 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:24.027743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-b44e53e8-c84e-4b00-a7ea-10500ae51f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:24.036235 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 690/1390] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:24.095654 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9eb12-0a67-4c4c-8327-fe82a587af8d None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:24.113556 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9eb12-0a67-4c4c-8327-fe82a587af8d None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:24.120173 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96ef3e-71c3-43f4-80e1-d70b52f681cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:24.120914 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96ef3e-71c3-43f4-80e1-d70b52f681cd service nova] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:24.121225 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96ef3e-71c3-43f4-80e1-d70b52f681cd service nova] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:24.121530 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96ef3e-71c3-43f4-80e1-d70b52f681cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:24.131688 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96ef3e-71c3-43f4-80e1-d70b52f681cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:24.133429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96ef3e-71c3-43f4-80e1-d70b52f681cd service nova] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:24.143953 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 701/1391] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:26.581948 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a65a4-4d64-4668-a31f-0230182dea78 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:26.582613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a65a4-4d64-4668-a31f-0230182dea78 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:26.582613 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a65a4-4d64-4668-a31f-0230182dea78 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:26.584028 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 691/1392] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:26.589659 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45a3f6-24ba-4703-89ee-8030a967020f None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:26.590156 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45a3f6-24ba-4703-89ee-8030a967020f None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:26.590259 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45a3f6-24ba-4703-89ee-8030a967020f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:26.610076 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-5f45a3f6-24ba-4703-89ee-8030a967020f None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:26.611291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-5f45a3f6-24ba-4703-89ee-8030a967020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:26.620307 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 702/1393] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:26.665904 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a65a4-4d64-4668-a31f-0230182dea78 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:26.681188 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a65a4-4d64-4668-a31f-0230182dea78 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:26.686729 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb66e9d-da19-44d4-911f-89ddf18b6493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:26.687383 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66e9d-da19-44d4-911f-89ddf18b6493 service nova] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:26.687675 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66e9d-da19-44d4-911f-89ddf18b6493 service nova] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:26.687944 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66e9d-da19-44d4-911f-89ddf18b6493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:26.697206 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb66e9d-da19-44d4-911f-89ddf18b6493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:26.698859 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb66e9d-da19-44d4-911f-89ddf18b6493 service nova] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:26.710929 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 692/1394] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:28.547135 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af080796-d591-4df0-becf-753966b7775a None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:28.547730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af080796-d591-4df0-becf-753966b7775a None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:28.547730 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af080796-d591-4df0-becf-753966b7775a None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:28.549121 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 703/1395] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:28.554850 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325db3a-79e1-491a-bb2f-b54fc1c63d5a None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:28.555377 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325db3a-79e1-491a-bb2f-b54fc1c63d5a None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:28.555488 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325db3a-79e1-491a-bb2f-b54fc1c63d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:28.561527 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=52 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:47:28.575368 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-2325db3a-79e1-491a-bb2f-b54fc1c63d5a None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:28.576597 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-2325db3a-79e1-491a-bb2f-b54fc1c63d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:28.585592 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 693/1396] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:28.645685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ff7e-0c61-4fd9-bb7f-0e94ebb2119c None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:28.645976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ff7e-0c61-4fd9-bb7f-0e94ebb2119c None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:28.646292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ff7e-0c61-4fd9-bb7f-0e94ebb2119c None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:28.648028 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 704/1397] 10.222.0.24 () {54 vars in 962 bytes} [Wed May 25 13:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:28.653058 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00df58-6fc2-432e-8806-be1691b2b5f9 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:28.653504 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00df58-6fc2-432e-8806-be1691b2b5f9 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:28.653788 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00df58-6fc2-432e-8806-be1691b2b5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:28.707940 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-9a00df58-6fc2-432e-8806-be1691b2b5f9 None None] MFA Rules not processed for user `62fbf54d04f84afd8dd9270b17207b04`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:28.709437 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-9a00df58-6fc2-432e-8806-be1691b2b5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:28.777463 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 694/1398] 10.222.0.24 () {58 vars in 1059 bytes} [Wed May 25 13:47:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:28.785383 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ff7e-0c61-4fd9-bb7f-0e94ebb2119c None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:28.798264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ff7e-0c61-4fd9-bb7f-0e94ebb2119c None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:28.802022 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe45b52-2249-4892-97cf-e23c32722175 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fbf54d04f84afd8dd9270b17207b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:28.802778 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe45b52-2249-4892-97cf-e23c32722175 service glance] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:28.803104 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe45b52-2249-4892-97cf-e23c32722175 service glance] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:28.803347 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe45b52-2249-4892-97cf-e23c32722175 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:28.813724 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe45b52-2249-4892-97cf-e23c32722175 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:28.815209 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe45b52-2249-4892-97cf-e23c32722175 service glance] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:28.826295 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 705/1399] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:28.992956 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2bbfb-345f-45f1-a9ed-9177944702c0 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:28.993299 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2bbfb-345f-45f1-a9ed-9177944702c0 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:28.993528 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2bbfb-345f-45f1-a9ed-9177944702c0 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:28.994907 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 695/1400] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:29.000330 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c7856-6830-4e6a-b88e-5148742f37d6 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:29.000632 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c7856-6830-4e6a-b88e-5148742f37d6 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:29.000913 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c7856-6830-4e6a-b88e-5148742f37d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:29.019708 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-4f7c7856-6830-4e6a-b88e-5148742f37d6 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:29.022306 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-4f7c7856-6830-4e6a-b88e-5148742f37d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:29.031337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 706/1401] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:29.077519 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2bbfb-345f-45f1-a9ed-9177944702c0 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:29.093131 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2bbfb-345f-45f1-a9ed-9177944702c0 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:29.102633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bba0e2-1292-451a-b3a6-5b52d2cbb198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:29.103465 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bba0e2-1292-451a-b3a6-5b52d2cbb198 service nova] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:29.103915 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bba0e2-1292-451a-b3a6-5b52d2cbb198 service nova] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:29.104268 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bba0e2-1292-451a-b3a6-5b52d2cbb198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:29.115182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bba0e2-1292-451a-b3a6-5b52d2cbb198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:29.117546 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bba0e2-1292-451a-b3a6-5b52d2cbb198 service nova] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:29.128092 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 696/1402] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:29.389517 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dc9af-e0a3-4f85-a042-a0a8dd7f2c7c None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:29.389808 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dc9af-e0a3-4f85-a042-a0a8dd7f2c7c None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:29.390097 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dc9af-e0a3-4f85-a042-a0a8dd7f2c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:29.440369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-c08dc9af-e0a3-4f85-a042-a0a8dd7f2c7c None None] MFA Rules not processed for user `b1e5039385f44bb2b52e795524d6b8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:29.441609 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-c08dc9af-e0a3-4f85-a042-a0a8dd7f2c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:29.489273 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=100 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:47:29.515739 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 707/1403] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 13:47:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:29.561494 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3089393-ec51-4f9f-bae5-2fff735bef24 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:29.562053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3089393-ec51-4f9f-bae5-2fff735bef24 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:29.562053 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3089393-ec51-4f9f-bae5-2fff735bef24 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:29.563519 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 697/1404] 10.222.0.24 () {54 vars in 942 bytes} [Wed May 25 13:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:47:29.571288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63257338-a0ac-497b-9ea4-941a6e83bc9d None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:29.571827 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63257338-a0ac-497b-9ea4-941a6e83bc9d None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:29.571982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63257338-a0ac-497b-9ea4-941a6e83bc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:29.629250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-63257338-a0ac-497b-9ea4-941a6e83bc9d None None] MFA Rules not processed for user `41c94d4eb019422fbea20bba97fa77a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:29.629858 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-63257338-a0ac-497b-9ea4-941a6e83bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:29.707041 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 708/1405] 10.222.0.24 () {58 vars in 1039 bytes} [Wed May 25 13:47:29 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:29.717198 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3089393-ec51-4f9f-bae5-2fff735bef24 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:29.735495 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3089393-ec51-4f9f-bae5-2fff735bef24 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:29.741273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91fc30-86cc-4225-9c2d-31c715483e90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c94d4eb019422fbea20bba97fa77a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:29.742040 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91fc30-86cc-4225-9c2d-31c715483e90 service swift] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:29.742326 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91fc30-86cc-4225-9c2d-31c715483e90 service swift] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:29.742608 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91fc30-86cc-4225-9c2d-31c715483e90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:29.751387 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91fc30-86cc-4225-9c2d-31c715483e90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:29.753020 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91fc30-86cc-4225-9c2d-31c715483e90 service swift] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:29.763175 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 698/1406] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 13:47:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 13:47:31.522480 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5e76a-c96d-4299-80a3-c21f651244cd None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:31.523034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5e76a-c96d-4299-80a3-c21f651244cd None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:31.523034 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5e76a-c96d-4299-80a3-c21f651244cd None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:31.524489 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 709/1407] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:31.531845 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0355-e7bc-45a7-bf00-9f1d7f8a270d None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:31.532400 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0355-e7bc-45a7-bf00-9f1d7f8a270d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:31.532691 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0355-e7bc-45a7-bf00-9f1d7f8a270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:31.555789 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-b6ee0355-e7bc-45a7-bf00-9f1d7f8a270d None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:31.557277 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-b6ee0355-e7bc-45a7-bf00-9f1d7f8a270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:31.565986 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 699/1408] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:31.611090 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5e76a-c96d-4299-80a3-c21f651244cd None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:31.627944 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5e76a-c96d-4299-80a3-c21f651244cd None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:31.633718 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee1ce9-024e-4c22-a571-2e88ba7ffe43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:31.634379 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee1ce9-024e-4c22-a571-2e88ba7ffe43 service nova] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:31.634668 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee1ce9-024e-4c22-a571-2e88ba7ffe43 service nova] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:31.634946 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee1ce9-024e-4c22-a571-2e88ba7ffe43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:31.643970 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee1ce9-024e-4c22-a571-2e88ba7ffe43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:31.645627 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee1ce9-024e-4c22-a571-2e88ba7ffe43 service nova] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:31.656390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 710/1409] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:47:41.549287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=55 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:47:41.652745 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=58 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:47:53.549394 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318ff2-0d52-4ed8-8b0c-e6145a4ba855 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:53.550036 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318ff2-0d52-4ed8-8b0c-e6145a4ba855 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:53.550036 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318ff2-0d52-4ed8-8b0c-e6145a4ba855 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:53.551306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 700/1410] 10.222.0.24 () {54 vars in 918 bytes} [Wed May 25 13:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:53.556557 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb4005-d5fc-48c9-8814-02e6a7a4d3f4 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:53.557053 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb4005-d5fc-48c9-8814-02e6a7a4d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:53.557183 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb4005-d5fc-48c9-8814-02e6a7a4d3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:53.575340 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-71fb4005-d5fc-48c9-8814-02e6a7a4d3f4 None None] MFA Rules not processed for user `9e134a7b368941eeb7223beb5b40c36a`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:53.576586 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-71fb4005-d5fc-48c9-8814-02e6a7a4d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:53.585703 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 711/1411] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 25 13:47:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:53.600463 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b54ae-1e41-4cd5-bfe4-d9c1539e2a2e None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:53.601289 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b54ae-1e41-4cd5-bfe4-d9c1539e2a2e None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:53.601713 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b54ae-1e41-4cd5-bfe4-d9c1539e2a2e None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:53.603218 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 701/1412] 10.222.0.24 () {54 vars in 918 bytes} [Wed May 25 13:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:53.608171 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b0ddb-92ff-424f-899b-552e8482ac73 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:53.608469 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b0ddb-92ff-424f-899b-552e8482ac73 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:53.608756 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b0ddb-92ff-424f-899b-552e8482ac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:53.627271 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-6c0b0ddb-92ff-424f-899b-552e8482ac73 None None] MFA Rules not processed for user `971eae8a8ad44ce893c311b74acbd76b`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:53.628523 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-6c0b0ddb-92ff-424f-899b-552e8482ac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:53.637898 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 712/1413] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 25 13:47:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:47:56.396044 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9fd42-46af-4261-9f39-694e7ea7ca78 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:56.396644 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9fd42-46af-4261-9f39-694e7ea7ca78 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:56.396851 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9fd42-46af-4261-9f39-694e7ea7ca78 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:56.398275 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:56.403804 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344941-1a6b-42ef-a5bb-dda2fcbd90d4 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:56.404274 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344941-1a6b-42ef-a5bb-dda2fcbd90d4 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:56.404408 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344941-1a6b-42ef-a5bb-dda2fcbd90d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:56.423717 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-15344941-1a6b-42ef-a5bb-dda2fcbd90d4 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:56.424982 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-15344941-1a6b-42ef-a5bb-dda2fcbd90d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:56.433972 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:56.479324 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9fd42-46af-4261-9f39-694e7ea7ca78 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:56.496517 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9fd42-46af-4261-9f39-694e7ea7ca78 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:56.504698 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81e54c-8a71-4352-9055-98489a49be12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:56.506306 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e54c-8a71-4352-9055-98489a49be12 service nova] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:56.506791 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e54c-8a71-4352-9055-98489a49be12 service nova] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:56.507287 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e54c-8a71-4352-9055-98489a49be12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:56.518797 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81e54c-8a71-4352-9055-98489a49be12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:56.520426 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81e54c-8a71-4352-9055-98489a49be12 service nova] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:56.531160 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 703/1416] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:57.517264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd0a2d-e3f3-4ba6-839d-267045f9a869 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:57.517961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd0a2d-e3f3-4ba6-839d-267045f9a869 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:57.517961 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd0a2d-e3f3-4ba6-839d-267045f9a869 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:57.519188 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:57.525139 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc17d-b06c-4e6e-9959-f68c738b8e85 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:57.525624 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc17d-b06c-4e6e-9959-f68c738b8e85 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:57.525735 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc17d-b06c-4e6e-9959-f68c738b8e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:57.546688 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-0b8bc17d-b06c-4e6e-9959-f68c738b8e85 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:57.547942 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-0b8bc17d-b06c-4e6e-9959-f68c738b8e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:57.556999 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:57.719342 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd0a2d-e3f3-4ba6-839d-267045f9a869 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:57.734685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd0a2d-e3f3-4ba6-839d-267045f9a869 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:57.740127 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdacc27-e44d-4e3a-87fb-2c6ae8dff656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:57.741359 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdacc27-e44d-4e3a-87fb-2c6ae8dff656 service nova] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:57.741644 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdacc27-e44d-4e3a-87fb-2c6ae8dff656 service nova] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:57.741922 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdacc27-e44d-4e3a-87fb-2c6ae8dff656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:57.750677 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdacc27-e44d-4e3a-87fb-2c6ae8dff656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:57.752326 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdacc27-e44d-4e3a-87fb-2c6ae8dff656 service nova] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:57.762291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 715/1419] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:47:58.713835 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218b088-80b0-4321-90e7-0463bb91e3e9 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:58.714332 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218b088-80b0-4321-90e7-0463bb91e3e9 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:58.714439 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218b088-80b0-4321-90e7-0463bb91e3e9 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:58.715774 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:58.721627 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636638d-5e71-40b3-97df-838ddb186697 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:58.722175 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636638d-5e71-40b3-97df-838ddb186697 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:58.722347 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636638d-5e71-40b3-97df-838ddb186697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:58.741578 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-9636638d-5e71-40b3-97df-838ddb186697 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:58.742794 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-9636638d-5e71-40b3-97df-838ddb186697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:58.750729 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:47:58.904513 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218b088-80b0-4321-90e7-0463bb91e3e9 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:47:58.920078 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218b088-80b0-4321-90e7-0463bb91e3e9 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:47:58.925620 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daebf36-ca09-4294-98ee-daf8ff949852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:47:58.926260 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daebf36-ca09-4294-98ee-daf8ff949852 service nova] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:58.926542 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daebf36-ca09-4294-98ee-daf8ff949852 service nova] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:58.926819 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daebf36-ca09-4294-98ee-daf8ff949852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:58.936236 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daebf36-ca09-4294-98ee-daf8ff949852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:47:58.937830 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daebf36-ca09-4294-98ee-daf8ff949852 service nova] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:47:58.951818 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 706/1422] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:47:59.883291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dfcc4-f74c-4494-9ad0-785d54c0ba9b None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:59.883882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dfcc4-f74c-4494-9ad0-785d54c0ba9b None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:59.883882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dfcc4-f74c-4494-9ad0-785d54c0ba9b None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:59.885250 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:47:59.890507 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5d96d-e78e-4c85-9e94-51cf3cddea92 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:47:59.890954 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5d96d-e78e-4c85-9e94-51cf3cddea92 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:47:59.891067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5d96d-e78e-4c85-9e94-51cf3cddea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:47:59.910210 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-0fa5d96d-e78e-4c85-9e94-51cf3cddea92 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:47:59.911423 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-0fa5d96d-e78e-4c85-9e94-51cf3cddea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:47:59.919751 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:00.079035 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dfcc4-f74c-4494-9ad0-785d54c0ba9b None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:00.094348 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dfcc4-f74c-4494-9ad0-785d54c0ba9b None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:00.100369 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4ee1b-dc87-42fa-aa2d-33de5ac9022a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:00.101027 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4ee1b-dc87-42fa-aa2d-33de5ac9022a service nova] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:00.101309 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4ee1b-dc87-42fa-aa2d-33de5ac9022a service nova] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:00.101585 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4ee1b-dc87-42fa-aa2d-33de5ac9022a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:00.110154 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4ee1b-dc87-42fa-aa2d-33de5ac9022a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:00.111781 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4ee1b-dc87-42fa-aa2d-33de5ac9022a service nova] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:00.122079 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 718/1425] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:01.092182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bca78-b113-484c-bc49-9ff795cd7e6e None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:01.092704 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bca78-b113-484c-bc49-9ff795cd7e6e None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:01.092704 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bca78-b113-484c-bc49-9ff795cd7e6e None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:01.094020 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:01.099564 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f8ca7-7fad-4211-bed5-779c1aacf252 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:01.100067 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f8ca7-7fad-4211-bed5-779c1aacf252 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:01.100336 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f8ca7-7fad-4211-bed5-779c1aacf252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:01.119763 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-ce8f8ca7-7fad-4211-bed5-779c1aacf252 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:01.121023 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-ce8f8ca7-7fad-4211-bed5-779c1aacf252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:01.129014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:01.285894 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bca78-b113-484c-bc49-9ff795cd7e6e None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:01.300457 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bca78-b113-484c-bc49-9ff795cd7e6e None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:01.306522 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d62c-39d7-476e-8475-b11591976ac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:01.307171 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d62c-39d7-476e-8475-b11591976ac1 service nova] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:01.307455 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d62c-39d7-476e-8475-b11591976ac1 service nova] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:01.307733 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d62c-39d7-476e-8475-b11591976ac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:01.316484 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6d62c-39d7-476e-8475-b11591976ac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:01.318075 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6d62c-39d7-476e-8475-b11591976ac1 service nova] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:01.328912 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 709/1428] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:02.201296 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c788a-3df9-4952-9d53-bb072bf472b1 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:02.201927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c788a-3df9-4952-9d53-bb072bf472b1 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:02.201927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c788a-3df9-4952-9d53-bb072bf472b1 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:02.203229 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:02.208648 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc40b-d218-4355-aa98-1f6ea43b76e8 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:02.209142 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc40b-d218-4355-aa98-1f6ea43b76e8 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:02.209245 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc40b-d218-4355-aa98-1f6ea43b76e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:02.229991 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-04edc40b-d218-4355-aa98-1f6ea43b76e8 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:02.231219 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-04edc40b-d218-4355-aa98-1f6ea43b76e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:02.239379 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:02.395318 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c788a-3df9-4952-9d53-bb072bf472b1 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:02.410087 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c788a-3df9-4952-9d53-bb072bf472b1 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:02.416427 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4cecc-da4d-4059-8ffb-520e87b464da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:02.417068 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4cecc-da4d-4059-8ffb-520e87b464da service nova] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:02.417349 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4cecc-da4d-4059-8ffb-520e87b464da service nova] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:02.417645 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4cecc-da4d-4059-8ffb-520e87b464da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:02.425948 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4cecc-da4d-4059-8ffb-520e87b464da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:02.427530 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4cecc-da4d-4059-8ffb-520e87b464da service nova] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:02.437591 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 721/1431] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:03.319190 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c90e-9e33-4174-b3e8-68cf181ecef9 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:03.319754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c90e-9e33-4174-b3e8-68cf181ecef9 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:03.319754 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c90e-9e33-4174-b3e8-68cf181ecef9 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:03.321199 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:03.326240 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5be561-38c5-4382-8f5d-5ef232013882 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:03.326685 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5be561-38c5-4382-8f5d-5ef232013882 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:03.326823 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5be561-38c5-4382-8f5d-5ef232013882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:03.345987 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-7b5be561-38c5-4382-8f5d-5ef232013882 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:03.347216 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-7b5be561-38c5-4382-8f5d-5ef232013882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:03.356360 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:03.508675 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542c90e-9e33-4174-b3e8-68cf181ecef9 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:03.523448 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542c90e-9e33-4174-b3e8-68cf181ecef9 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:03.528810 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17c24e-d26c-4cdd-bcc7-2d7c90264cd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:03.529449 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17c24e-d26c-4cdd-bcc7-2d7c90264cd4 service nova] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:03.529729 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17c24e-d26c-4cdd-bcc7-2d7c90264cd4 service nova] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:03.530004 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17c24e-d26c-4cdd-bcc7-2d7c90264cd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:03.539311 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17c24e-d26c-4cdd-bcc7-2d7c90264cd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:03.540973 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17c24e-d26c-4cdd-bcc7-2d7c90264cd4 service nova] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:03.550711 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 712/1434] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:04.425313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e51754-ffa7-4de1-93c5-41ca858ae2fb None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:04.425869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e51754-ffa7-4de1-93c5-41ca858ae2fb None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:04.425869 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e51754-ffa7-4de1-93c5-41ca858ae2fb None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:04.427283 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:04.432857 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7a8fa-52ca-40fa-9a6f-ea4d2954711d None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:04.433313 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7a8fa-52ca-40fa-9a6f-ea4d2954711d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:04.433423 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7a8fa-52ca-40fa-9a6f-ea4d2954711d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:04.451339 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-0fa7a8fa-52ca-40fa-9a6f-ea4d2954711d None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:04.452575 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-0fa7a8fa-52ca-40fa-9a6f-ea4d2954711d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:04.460474 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:04.611893 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e51754-ffa7-4de1-93c5-41ca858ae2fb None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:04.626600 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e51754-ffa7-4de1-93c5-41ca858ae2fb None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:04.632864 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a0133-31e7-4ff0-9723-026852922261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:04.633512 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a0133-31e7-4ff0-9723-026852922261 service nova] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:04.633797 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a0133-31e7-4ff0-9723-026852922261 service nova] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:04.634077 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a0133-31e7-4ff0-9723-026852922261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:04.642735 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a0133-31e7-4ff0-9723-026852922261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:04.644372 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a0133-31e7-4ff0-9723-026852922261 service nova] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:04.654758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 724/1437] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:05.528894 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bcd63-a3f8-49c5-a5eb-a713b60f2a25 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:05.529475 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bcd63-a3f8-49c5-a5eb-a713b60f2a25 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:05.529475 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bcd63-a3f8-49c5-a5eb-a713b60f2a25 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:05.530807 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:05.535910 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274a9fd-d462-4de1-8848-d910acba446b None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:05.536593 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274a9fd-d462-4de1-8848-d910acba446b None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:05.536593 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274a9fd-d462-4de1-8848-d910acba446b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:05.555241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-9274a9fd-d462-4de1-8848-d910acba446b None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:05.556509 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-9274a9fd-d462-4de1-8848-d910acba446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:05.564505 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:05.713876 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bcd63-a3f8-49c5-a5eb-a713b60f2a25 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:05.729366 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bcd63-a3f8-49c5-a5eb-a713b60f2a25 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:05.734812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668f769-a6eb-44a6-b417-df893bff6d9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:05.735470 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668f769-a6eb-44a6-b417-df893bff6d9b service nova] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:05.735758 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668f769-a6eb-44a6-b417-df893bff6d9b service nova] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:05.736028 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668f769-a6eb-44a6-b417-df893bff6d9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:05.745897 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668f769-a6eb-44a6-b417-df893bff6d9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:05.747482 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668f769-a6eb-44a6-b417-df893bff6d9b service nova] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:05.757901 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 715/1440] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:07.961537 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9617f8a-82f1-49d3-8027-e3a91ce29bd9 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:07.962093 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9617f8a-82f1-49d3-8027-e3a91ce29bd9 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:07.962228 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9617f8a-82f1-49d3-8027-e3a91ce29bd9 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:07.963628 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:07.973505 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cbd41-6bcb-436f-ad84-23bca0c1f647 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:07.974124 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cbd41-6bcb-436f-ad84-23bca0c1f647 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:07.974124 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cbd41-6bcb-436f-ad84-23bca0c1f647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:07.995534 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-9f6cbd41-6bcb-436f-ad84-23bca0c1f647 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:07.997545 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-9f6cbd41-6bcb-436f-ad84-23bca0c1f647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:08.008532 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:08.049572 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9617f8a-82f1-49d3-8027-e3a91ce29bd9 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:08.062513 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9617f8a-82f1-49d3-8027-e3a91ce29bd9 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:08.070828 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd5eff-7eb4-4ff6-af3d-daba56b78085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:08.072184 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd5eff-7eb4-4ff6-af3d-daba56b78085 service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:08.072534 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd5eff-7eb4-4ff6-af3d-daba56b78085 service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:08.072989 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd5eff-7eb4-4ff6-af3d-daba56b78085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:08.087347 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd5eff-7eb4-4ff6-af3d-daba56b78085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:08.088897 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd5eff-7eb4-4ff6-af3d-daba56b78085 service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:08.103437 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 727/1443] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:10.625535 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71fcb2-c9bf-49a9-9aa9-e28816348f81 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:10.626110 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71fcb2-c9bf-49a9-9aa9-e28816348f81 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:10.626110 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71fcb2-c9bf-49a9-9aa9-e28816348f81 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:10.627493 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:10.632782 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e5434-92b6-4ea3-acec-8ab3872081bf None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:10.633235 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e5434-92b6-4ea3-acec-8ab3872081bf None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:10.633457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e5434-92b6-4ea3-acec-8ab3872081bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:10.651299 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-936e5434-92b6-4ea3-acec-8ab3872081bf None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:10.652549 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-936e5434-92b6-4ea3-acec-8ab3872081bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:10.660448 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:10.699831 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71fcb2-c9bf-49a9-9aa9-e28816348f81 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:10.711140 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71fcb2-c9bf-49a9-9aa9-e28816348f81 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:10.714724 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebedcd7-d1b1-4d95-bf07-44740a9a4ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:10.715367 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebedcd7-d1b1-4d95-bf07-44740a9a4ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:10.715653 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebedcd7-d1b1-4d95-bf07-44740a9a4ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:10.715927 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebedcd7-d1b1-4d95-bf07-44740a9a4ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:10.726686 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebedcd7-d1b1-4d95-bf07-44740a9a4ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:10.728151 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebedcd7-d1b1-4d95-bf07-44740a9a4ee6 service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:10.737669 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 718/1446] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:13.288144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9950101-1154-4705-ac80-7480c3b13e37 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:13.288758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9950101-1154-4705-ac80-7480c3b13e37 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:13.288758 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9950101-1154-4705-ac80-7480c3b13e37 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:13.290056 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:13.295399 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308a622-0c0b-4e16-b46b-c5bc8583b7a7 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:13.295874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308a622-0c0b-4e16-b46b-c5bc8583b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:13.295989 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308a622-0c0b-4e16-b46b-c5bc8583b7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:13.314002 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-b308a622-0c0b-4e16-b46b-c5bc8583b7a7 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:13.315204 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-b308a622-0c0b-4e16-b46b-c5bc8583b7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:13.323563 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:13.362329 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9950101-1154-4705-ac80-7480c3b13e37 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:13.373222 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9950101-1154-4705-ac80-7480c3b13e37 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:13.377202 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ceaf5-5574-4368-b4e0-fdfbab7985e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:13.377834 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ceaf5-5574-4368-b4e0-fdfbab7985e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:13.378114 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ceaf5-5574-4368-b4e0-fdfbab7985e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:13.378384 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ceaf5-5574-4368-b4e0-fdfbab7985e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:13.388292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ceaf5-5574-4368-b4e0-fdfbab7985e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:13.389693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ceaf5-5574-4368-b4e0-fdfbab7985e7 service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:13.399950 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 730/1449] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:15.758803 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ed5ac-07a5-4e02-a23f-f07700728a90 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:15.759411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ed5ac-07a5-4e02-a23f-f07700728a90 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:15.759411 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ed5ac-07a5-4e02-a23f-f07700728a90 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:15.760748 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:15.766144 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241c784-44ab-4eeb-8441-a8054b83789e None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:15.766687 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241c784-44ab-4eeb-8441-a8054b83789e None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:15.766687 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241c784-44ab-4eeb-8441-a8054b83789e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:15.785328 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-7241c784-44ab-4eeb-8441-a8054b83789e None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:15.786540 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-7241c784-44ab-4eeb-8441-a8054b83789e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:15.795302 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:15.833490 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ed5ac-07a5-4e02-a23f-f07700728a90 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:15.845665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ed5ac-07a5-4e02-a23f-f07700728a90 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:15.849369 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae49c5e-1824-478b-aefc-c14fab270a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:15.850280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae49c5e-1824-478b-aefc-c14fab270a00 service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:15.850564 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae49c5e-1824-478b-aefc-c14fab270a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:15.850839 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae49c5e-1824-478b-aefc-c14fab270a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:15.859746 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae49c5e-1824-478b-aefc-c14fab270a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:15.861194 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae49c5e-1824-478b-aefc-c14fab270a00 service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:15.870943 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 721/1452] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:18.161623 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dff73-d147-4b00-bb6d-e266d44b117d None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:18.162707 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dff73-d147-4b00-bb6d-e266d44b117d None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:18.162944 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dff73-d147-4b00-bb6d-e266d44b117d None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:18.164411 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:18.169924 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45e6e3-878d-4f9b-8a2e-6ca15c27cc10 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:18.170416 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45e6e3-878d-4f9b-8a2e-6ca15c27cc10 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:18.170520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45e6e3-878d-4f9b-8a2e-6ca15c27cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:18.188705 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-5f45e6e3-878d-4f9b-8a2e-6ca15c27cc10 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:18.189905 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-5f45e6e3-878d-4f9b-8a2e-6ca15c27cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:18.199300 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:18.237533 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dff73-d147-4b00-bb6d-e266d44b117d None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:18.249313 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dff73-d147-4b00-bb6d-e266d44b117d None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:18.252926 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5238c-ffcc-42ae-b5df-8c5047efd20d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:18.253566 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5238c-ffcc-42ae-b5df-8c5047efd20d service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:18.253883 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5238c-ffcc-42ae-b5df-8c5047efd20d service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:18.254128 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5238c-ffcc-42ae-b5df-8c5047efd20d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:18.263603 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5238c-ffcc-42ae-b5df-8c5047efd20d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:18.265082 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5238c-ffcc-42ae-b5df-8c5047efd20d service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:18.276178 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 733/1455] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:20.556389 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41215c-cc0f-4608-be3c-d39336caf24d None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:20.556957 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41215c-cc0f-4608-be3c-d39336caf24d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:20.556957 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41215c-cc0f-4608-be3c-d39336caf24d None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:20.558322 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:20.563766 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c44b1d-ff33-4227-8962-3a481c0ab5b6 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:20.564249 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c44b1d-ff33-4227-8962-3a481c0ab5b6 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:20.564359 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c44b1d-ff33-4227-8962-3a481c0ab5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:20.583123 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-91c44b1d-ff33-4227-8962-3a481c0ab5b6 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:20.584469 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-91c44b1d-ff33-4227-8962-3a481c0ab5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:20.592429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:20.630312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41215c-cc0f-4608-be3c-d39336caf24d None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:20.641964 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41215c-cc0f-4608-be3c-d39336caf24d None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:20.645519 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15add6cb-ce9f-474d-b94c-acbe1c032807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:20.646185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15add6cb-ce9f-474d-b94c-acbe1c032807 service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:20.646673 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15add6cb-ce9f-474d-b94c-acbe1c032807 service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:20.647125 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15add6cb-ce9f-474d-b94c-acbe1c032807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:20.656557 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15add6cb-ce9f-474d-b94c-acbe1c032807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:20.658010 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15add6cb-ce9f-474d-b94c-acbe1c032807 service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:20.667753 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 724/1458] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:22.979051 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29753bf-0ee3-4466-84ad-f6657f68da31 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:22.979589 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29753bf-0ee3-4466-84ad-f6657f68da31 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:22.979589 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29753bf-0ee3-4466-84ad-f6657f68da31 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:22.980993 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:22.986447 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf31c0-46b4-4607-a4d5-8d80cc7cfcfa None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:22.986894 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf31c0-46b4-4607-a4d5-8d80cc7cfcfa None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:22.987012 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf31c0-46b4-4607-a4d5-8d80cc7cfcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:22.993185 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=70 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:48:23.005740 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-adaf31c0-46b4-4607-a4d5-8d80cc7cfcfa None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:23.007120 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-adaf31c0-46b4-4607-a4d5-8d80cc7cfcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:23.018195 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:23.057210 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29753bf-0ee3-4466-84ad-f6657f68da31 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:23.062784 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=73 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:48:23.069133 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29753bf-0ee3-4466-84ad-f6657f68da31 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:23.072698 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db0d20-8934-474f-84a2-b575f85891c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:23.073341 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db0d20-8934-474f-84a2-b575f85891c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:23.073623 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db0d20-8934-474f-84a2-b575f85891c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:23.073902 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db0d20-8934-474f-84a2-b575f85891c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:23.083294 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db0d20-8934-474f-84a2-b575f85891c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:23.085474 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db0d20-8934-474f-84a2-b575f85891c2 service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:23.094984 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 736/1461] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:25.551325 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10687731-e72b-40dc-9e21-3602a97cf164 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:25.551912 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10687731-e72b-40dc-9e21-3602a97cf164 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:25.551912 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10687731-e72b-40dc-9e21-3602a97cf164 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:25.553995 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:25.559590 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95117f6-23e5-4be4-8a29-caae2b81c848 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:25.560024 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95117f6-23e5-4be4-8a29-caae2b81c848 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:25.560187 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95117f6-23e5-4be4-8a29-caae2b81c848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:25.584589 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-e95117f6-23e5-4be4-8a29-caae2b81c848 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:25.585821 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-e95117f6-23e5-4be4-8a29-caae2b81c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:25.593639 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:25.632464 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10687731-e72b-40dc-9e21-3602a97cf164 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:25.643390 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10687731-e72b-40dc-9e21-3602a97cf164 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:25.647059 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82922bc4-09e7-40af-a5b4-d0f134ec960e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:25.647700 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82922bc4-09e7-40af-a5b4-d0f134ec960e service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:25.647983 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82922bc4-09e7-40af-a5b4-d0f134ec960e service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:25.648296 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82922bc4-09e7-40af-a5b4-d0f134ec960e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:25.657598 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82922bc4-09e7-40af-a5b4-d0f134ec960e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:25.659023 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82922bc4-09e7-40af-a5b4-d0f134ec960e service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:25.669236 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 727/1464] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:28.084247 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e43f2-6c9c-41fe-bc27-5e54e29ac7a3 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:28.085035 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e43f2-6c9c-41fe-bc27-5e54e29ac7a3 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:28.085341 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e43f2-6c9c-41fe-bc27-5e54e29ac7a3 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:28.086740 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:28.092514 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88ab82-3d51-4abe-bc84-7f9fd1bc988b None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:28.093017 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88ab82-3d51-4abe-bc84-7f9fd1bc988b None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:28.093149 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88ab82-3d51-4abe-bc84-7f9fd1bc988b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:28.111954 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-ab88ab82-3d51-4abe-bc84-7f9fd1bc988b None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:28.113408 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-ab88ab82-3d51-4abe-bc84-7f9fd1bc988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:28.121941 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:28.158484 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e43f2-6c9c-41fe-bc27-5e54e29ac7a3 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:28.170268 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e43f2-6c9c-41fe-bc27-5e54e29ac7a3 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:28.173837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79f9d1-51d9-4760-a26c-54e57df94450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:28.174484 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f9d1-51d9-4760-a26c-54e57df94450 service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:28.174772 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f9d1-51d9-4760-a26c-54e57df94450 service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:28.175052 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f9d1-51d9-4760-a26c-54e57df94450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:28.184704 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79f9d1-51d9-4760-a26c-54e57df94450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:28.186155 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79f9d1-51d9-4760-a26c-54e57df94450 service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:28.195918 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 739/1467] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:30.446636 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410d80e-f8f4-4b31-a42b-aad84cceea34 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:30.447219 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410d80e-f8f4-4b31-a42b-aad84cceea34 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:30.447219 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410d80e-f8f4-4b31-a42b-aad84cceea34 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:30.448601 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:30.454142 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea7603-5ad3-40a5-8120-cb5f403ef5fa None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:30.454581 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea7603-5ad3-40a5-8120-cb5f403ef5fa None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:30.454693 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea7603-5ad3-40a5-8120-cb5f403ef5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:30.472796 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-33ea7603-5ad3-40a5-8120-cb5f403ef5fa None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:30.474012 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-33ea7603-5ad3-40a5-8120-cb5f403ef5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:30.482192 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:30.520221 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410d80e-f8f4-4b31-a42b-aad84cceea34 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:30.522232 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-b410d80e-f8f4-4b31-a42b-aad84cceea34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:30.535424 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410d80e-f8f4-4b31-a42b-aad84cceea34 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:30.539113 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867231e-5d1f-42cb-93df-f46a572ee4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:30.539757 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867231e-5d1f-42cb-93df-f46a572ee4bc service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:30.540041 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867231e-5d1f-42cb-93df-f46a572ee4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:30.540365 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867231e-5d1f-42cb-93df-f46a572ee4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:30.549385 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867231e-5d1f-42cb-93df-f46a572ee4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:30.550843 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867231e-5d1f-42cb-93df-f46a572ee4bc service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:30.561303 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 730/1470] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:40.467293 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=17 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:48:40.557079 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=17 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:49:04.109094 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9e475-3131-4528-8a42-70ad841f6ef1 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:04.109664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9e475-3131-4528-8a42-70ad841f6ef1 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:04.109664 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9e475-3131-4528-8a42-70ad841f6ef1 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:04.111070 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 741/1471] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:49:04.116908 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138a6b2-eae7-47bb-bbe4-8bb540c3beb2 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:04.117340 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138a6b2-eae7-47bb-bbe4-8bb540c3beb2 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:04.117456 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138a6b2-eae7-47bb-bbe4-8bb540c3beb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:04.135891 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-1138a6b2-eae7-47bb-bbe4-8bb540c3beb2 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:49:04.137148 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-1138a6b2-eae7-47bb-bbe4-8bb540c3beb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:49:04.144955 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 731/1472] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:49:04.191769 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e906935-5506-4219-a4e2-0fef5c614dd1 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:04.192060 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e906935-5506-4219-a4e2-0fef5c614dd1 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:04.192437 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e906935-5506-4219-a4e2-0fef5c614dd1 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:04.194390 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 742/1473] 10.222.0.24 () {54 vars in 962 bytes} [Wed May 25 13:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:49:04.199444 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a916d-ccb6-4f6c-8c0d-47590c07714f None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:04.199739 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a916d-ccb6-4f6c-8c0d-47590c07714f None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:04.200026 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a916d-ccb6-4f6c-8c0d-47590c07714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:04.219388 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-8d7a916d-ccb6-4f6c-8c0d-47590c07714f None None] MFA Rules not processed for user `62fbf54d04f84afd8dd9270b17207b04`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:49:04.220632 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-8d7a916d-ccb6-4f6c-8c0d-47590c07714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:49:04.229452 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 732/1474] 10.222.0.24 () {58 vars in 1059 bytes} [Wed May 25 13:49:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:49:04.237076 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e906935-5506-4219-a4e2-0fef5c614dd1 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:49:04.249014 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e906935-5506-4219-a4e2-0fef5c614dd1 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:49:04.252578 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3f545-57f5-41da-bbd5-e66a75367c0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fbf54d04f84afd8dd9270b17207b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:49:04.253224 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f545-57f5-41da-bbd5-e66a75367c0b service glance] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:04.253514 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f545-57f5-41da-bbd5-e66a75367c0b service glance] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:04.253792 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f545-57f5-41da-bbd5-e66a75367c0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:04.263783 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3f545-57f5-41da-bbd5-e66a75367c0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:49:04.265288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3f545-57f5-41da-bbd5-e66a75367c0b service glance] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:49:04.274733 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 743/1475] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:49:06.589743 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a0ff4-c6db-4d75-af34-43a58886a43a None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:06.590304 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a0ff4-c6db-4d75-af34-43a58886a43a None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:06.590304 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a0ff4-c6db-4d75-af34-43a58886a43a None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:06.591729 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 733/1476] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:49:06.597312 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c992795-56ce-400a-9c68-0c15e705e7cf None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:06.597828 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c992795-56ce-400a-9c68-0c15e705e7cf None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:06.597932 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c992795-56ce-400a-9c68-0c15e705e7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:06.616619 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-6c992795-56ce-400a-9c68-0c15e705e7cf None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:49:06.617842 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-6c992795-56ce-400a-9c68-0c15e705e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:49:06.625622 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 744/1477] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:49:06.649271 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a0ff4-c6db-4d75-af34-43a58886a43a None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:49:06.662252 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a0ff4-c6db-4d75-af34-43a58886a43a None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:49:06.666896 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f5ed-073a-4acf-9875-f7c61c998421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:49:06.667549 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f5ed-073a-4acf-9875-f7c61c998421 admin admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:06.667835 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f5ed-073a-4acf-9875-f7c61c998421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:06.668135 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f5ed-073a-4acf-9875-f7c61c998421 admin admin] PATH_INFO: `/v3/projects` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:06.668882 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655f5ed-073a-4acf-9875-f7c61c998421 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:49:06.670650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: WARNING py.warnings [None req-2655f5ed-073a-4acf-9875-f7c61c998421 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:49:06.670650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: warnings.warn(msg) May 25 13:49:06.670650 dv-cinder-803823-8-smb devstack@keystone.service[86643]: May 25 13:49:06.671802 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655f5ed-073a-4acf-9875-f7c61c998421 admin admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:49:06.691571 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 734/1478] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 13:49:06 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:49:09.076288 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac877a5-e64c-4960-958c-741261cea4c8 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:09.076940 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac877a5-e64c-4960-958c-741261cea4c8 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:09.076940 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac877a5-e64c-4960-958c-741261cea4c8 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:09.078190 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 745/1479] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:49:09.083574 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e9775-9b31-48fd-b245-23a7cb4d4805 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:09.084072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e9775-9b31-48fd-b245-23a7cb4d4805 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:09.084777 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e9775-9b31-48fd-b245-23a7cb4d4805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:09.102784 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-d77e9775-9b31-48fd-b245-23a7cb4d4805 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:49:09.104021 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-d77e9775-9b31-48fd-b245-23a7cb4d4805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:49:09.112349 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 735/1480] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:49:09.156776 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac877a5-e64c-4960-958c-741261cea4c8 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:49:09.171576 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac877a5-e64c-4960-958c-741261cea4c8 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:49:09.176979 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2ae65-60ff-4bac-a382-10024c7d4b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971eae8a8ad44ce893c311b74acbd76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:49:09.177657 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2ae65-60ff-4bac-a382-10024c7d4b41 service nova] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:09.177985 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2ae65-60ff-4bac-a382-10024c7d4b41 service nova] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:09.178261 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2ae65-60ff-4bac-a382-10024c7d4b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:09.186563 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2ae65-60ff-4bac-a382-10024c7d4b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:49:09.188190 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2ae65-60ff-4bac-a382-10024c7d4b41 service nova] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:49:09.198296 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 746/1481] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:49:11.619271 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279245b-439f-483f-96df-46482e48825c None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:11.619852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279245b-439f-483f-96df-46482e48825c None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:11.619852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279245b-439f-483f-96df-46482e48825c None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:11.621267 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 736/1482] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:49:11.626444 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130abb2f-cca9-49ff-8969-3c99e0837caf None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:11.626836 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130abb2f-cca9-49ff-8969-3c99e0837caf None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:11.626995 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130abb2f-cca9-49ff-8969-3c99e0837caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:11.645134 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-130abb2f-cca9-49ff-8969-3c99e0837caf None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:49:11.646346 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-130abb2f-cca9-49ff-8969-3c99e0837caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:49:11.654242 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 747/1483] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:49:11.689518 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279245b-439f-483f-96df-46482e48825c None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:49:11.700665 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279245b-439f-483f-96df-46482e48825c None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:49:11.704166 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d855b-5b17-4a2a-b1f9-e7758f1df363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:49:11.704812 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d855b-5b17-4a2a-b1f9-e7758f1df363 service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:11.705094 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d855b-5b17-4a2a-b1f9-e7758f1df363 service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:11.705372 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d855b-5b17-4a2a-b1f9-e7758f1df363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:11.715706 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d855b-5b17-4a2a-b1f9-e7758f1df363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:49:11.717187 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d855b-5b17-4a2a-b1f9-e7758f1df363 service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:49:11.727880 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 737/1484] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:49:14.058188 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ad08b-d423-458a-9da1-b7533b5a2535 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:14.058722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ad08b-d423-458a-9da1-b7533b5a2535 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:14.058722 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ad08b-d423-458a-9da1-b7533b5a2535 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:14.060040 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 748/1485] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:49:14.065310 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddce7b-0cd3-4efc-a18f-aeb9421d85e7 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:14.065727 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddce7b-0cd3-4efc-a18f-aeb9421d85e7 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:14.065874 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddce7b-0cd3-4efc-a18f-aeb9421d85e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:14.087441 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-56ddce7b-0cd3-4efc-a18f-aeb9421d85e7 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:49:14.088718 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-56ddce7b-0cd3-4efc-a18f-aeb9421d85e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:49:14.097015 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 738/1486] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:49:14.136025 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ad08b-d423-458a-9da1-b7533b5a2535 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:49:14.146726 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ad08b-d423-458a-9da1-b7533b5a2535 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:49:14.150292 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792e0c2-84f9-4840-b9cb-d44ab9d41c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:49:14.150926 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792e0c2-84f9-4840-b9cb-d44ab9d41c35 service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:14.151207 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792e0c2-84f9-4840-b9cb-d44ab9d41c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:14.151480 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792e0c2-84f9-4840-b9cb-d44ab9d41c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:14.160811 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792e0c2-84f9-4840-b9cb-d44ab9d41c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:49:14.162746 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792e0c2-84f9-4840-b9cb-d44ab9d41c35 service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:49:14.172236 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 749/1487] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:49:16.591200 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72fc8e-1263-43cf-b83d-de5ae447196d None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:16.591741 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72fc8e-1263-43cf-b83d-de5ae447196d None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:16.591741 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72fc8e-1263-43cf-b83d-de5ae447196d None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:16.593271 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 739/1488] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:49:16.599156 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e03004-40d3-46a1-84ed-56c97d72e4b7 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:16.600222 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e03004-40d3-46a1-84ed-56c97d72e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:16.600495 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e03004-40d3-46a1-84ed-56c97d72e4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:16.620219 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-81e03004-40d3-46a1-84ed-56c97d72e4b7 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:49:16.621429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-81e03004-40d3-46a1-84ed-56c97d72e4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:49:16.629232 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 750/1489] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:49:16.669916 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72fc8e-1263-43cf-b83d-de5ae447196d None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:49:16.681390 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72fc8e-1263-43cf-b83d-de5ae447196d None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:49:16.684955 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cde74-47e7-4cb5-8d71-b7d1efb2fbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:49:16.685611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cde74-47e7-4cb5-8d71-b7d1efb2fbdb service neutron] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:16.685875 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cde74-47e7-4cb5-8d71-b7d1efb2fbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:16.686153 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cde74-47e7-4cb5-8d71-b7d1efb2fbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:16.694949 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cde74-47e7-4cb5-8d71-b7d1efb2fbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:49:16.696416 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cde74-47e7-4cb5-8d71-b7d1efb2fbdb service neutron] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:49:16.706116 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 740/1490] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:49:19.134954 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b14a46-4f18-4c34-9dfb-6b39d18aaa77 None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:19.135492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b14a46-4f18-4c34-9dfb-6b39d18aaa77 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:19.135492 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b14a46-4f18-4c34-9dfb-6b39d18aaa77 None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:19.136915 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 751/1491] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 13:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:49:19.142403 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d04f-8f59-45de-bb81-7ce9424f98d4 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:19.142850 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d04f-8f59-45de-bb81-7ce9424f98d4 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:19.142946 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d04f-8f59-45de-bb81-7ce9424f98d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:19.161240 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-4cf7d04f-8f59-45de-bb81-7ce9424f98d4 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:49:19.163067 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-4cf7d04f-8f59-45de-bb81-7ce9424f98d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:49:19.170923 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 741/1492] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 13:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:49:19.209616 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b14a46-4f18-4c34-9dfb-6b39d18aaa77 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:49:19.220351 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b14a46-4f18-4c34-9dfb-6b39d18aaa77 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:49:19.225111 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9e6c5-c7db-438b-8848-bd9dbde05454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:49:19.225856 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9e6c5-c7db-438b-8848-bd9dbde05454 service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:49:19.226138 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9e6c5-c7db-438b-8848-bd9dbde05454 service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:49:19.226416 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9e6c5-c7db-438b-8848-bd9dbde05454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:49:19.235457 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9e6c5-c7db-438b-8848-bd9dbde05454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:49:19.236935 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9e6c5-c7db-438b-8848-bd9dbde05454 service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:49:19.246419 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 752/1493] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:49:29.156062 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=33 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:49:29.242337 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=33 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:04.794330 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448cbff-7088-489e-b5b2-193748fa2e69 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.794889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448cbff-7088-489e-b5b2-193748fa2e69 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.794889 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448cbff-7088-489e-b5b2-193748fa2e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.812562 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-2448cbff-7088-489e-b5b2-193748fa2e69 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:04.813791 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-2448cbff-7088-489e-b5b2-193748fa2e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:04.821661 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 742/1494] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 13:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:04.830937 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51751c-2e53-4e73-8cf3-083e1b10de74 None None] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.831429 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51751c-2e53-4e73-8cf3-083e1b10de74 None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.831523 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51751c-2e53-4e73-8cf3-083e1b10de74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.850642 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.auth.core [None req-1b51751c-2e53-4e73-8cf3-083e1b10de74 None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:04.851854 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-1b51751c-2e53-4e73-8cf3-083e1b10de74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:04.859657 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 753/1495] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 13:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:04.864341 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448cbff-7088-489e-b5b2-193748fa2e69 None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:04.873937 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448cbff-7088-489e-b5b2-193748fa2e69 None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:04.878511 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcef70c-63da-41c9-bb5d-50bba3e6f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:04.879160 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcef70c-63da-41c9-bb5d-50bba3e6f3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.879443 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcef70c-63da-41c9-bb5d-50bba3e6f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.879725 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcef70c-63da-41c9-bb5d-50bba3e6f3f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.880483 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcef70c-63da-41c9-bb5d-50bba3e6f3f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:04.880794 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcef70c-63da-41c9-bb5d-50bba3e6f3f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:04.881801 dv-cinder-803823-8-smb devstack@keystone.service[86643]: WARNING py.warnings [None req-fbcef70c-63da-41c9-bb5d-50bba3e6f3f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 13:51:04.881801 dv-cinder-803823-8-smb devstack@keystone.service[86643]: warnings.warn(msg) May 25 13:51:04.881801 dv-cinder-803823-8-smb devstack@keystone.service[86643]: May 25 13:51:04.882680 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcef70c-63da-41c9-bb5d-50bba3e6f3f3 admin admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:04.894747 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 743/1496] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 13:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:04.902940 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51751c-2e53-4e73-8cf3-083e1b10de74 None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:04.912719 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51751c-2e53-4e73-8cf3-083e1b10de74 None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:04.917353 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c8017-0438-41d8-aed6-7847c76c28c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:04.918008 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c8017-0438-41d8-aed6-7847c76c28c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.918291 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c8017-0438-41d8-aed6-7847c76c28c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.918571 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c8017-0438-41d8-aed6-7847c76c28c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.919264 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c8017-0438-41d8-aed6-7847c76c28c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:04.921068 dv-cinder-803823-8-smb devstack@keystone.service[86644]: WARNING py.warnings [None req-1d7c8017-0438-41d8-aed6-7847c76c28c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:51:04.921068 dv-cinder-803823-8-smb devstack@keystone.service[86644]: warnings.warn(msg) May 25 13:51:04.921068 dv-cinder-803823-8-smb devstack@keystone.service[86644]: May 25 13:51:04.922274 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c8017-0438-41d8-aed6-7847c76c28c9 admin admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:04.961959 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 754/1497] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 13:51:04 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:04.968099 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcef70c-63da-41c9-bb5d-50bba3e6f3f3 admin admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:04.979072 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcef70c-63da-41c9-bb5d-50bba3e6f3f3 admin admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:05.037312 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598eb0d-59d8-400a-87af-ef855b28b44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:05.037982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598eb0d-59d8-400a-87af-ef855b28b44b admin admin] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.038264 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598eb0d-59d8-400a-87af-ef855b28b44b admin admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.038539 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598eb0d-59d8-400a-87af-ef855b28b44b admin admin] PATH_INFO: `/v3/users` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.039243 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598eb0d-59d8-400a-87af-ef855b28b44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:05.040280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: WARNING py.warnings [None req-f598eb0d-59d8-400a-87af-ef855b28b44b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:51:05.040280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: warnings.warn(msg) May 25 13:51:05.040280 dv-cinder-803823-8-smb devstack@keystone.service[86643]: May 25 13:51:05.041483 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598eb0d-59d8-400a-87af-ef855b28b44b admin admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:05.060982 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 744/1498] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 13:51:04 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:05.065206 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c8017-0438-41d8-aed6-7847c76c28c9 admin admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:05.076669 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c8017-0438-41d8-aed6-7847c76c28c9 admin admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:05.081148 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eae4e-0b1c-4d32-8adb-3b59fded8dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:05.082465 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eae4e-0b1c-4d32-8adb-3b59fded8dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.082976 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eae4e-0b1c-4d32-8adb-3b59fded8dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.083270 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eae4e-0b1c-4d32-8adb-3b59fded8dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.084004 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031eae4e-0b1c-4d32-8adb-3b59fded8dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:05.085068 dv-cinder-803823-8-smb devstack@keystone.service[86644]: WARNING py.warnings [None req-031eae4e-0b1c-4d32-8adb-3b59fded8dd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 13:51:05.085068 dv-cinder-803823-8-smb devstack@keystone.service[86644]: warnings.warn(msg) May 25 13:51:05.085068 dv-cinder-803823-8-smb devstack@keystone.service[86644]: May 25 13:51:05.085969 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031eae4e-0b1c-4d32-8adb-3b59fded8dd6 admin admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:05.099522 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 755/1499] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 13:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:05.103508 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598eb0d-59d8-400a-87af-ef855b28b44b admin admin] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:05.113394 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598eb0d-59d8-400a-87af-ef855b28b44b admin admin] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:05.117978 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793fe3c-76c0-4782-bc23-fc7d1c6c5266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:05.118629 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793fe3c-76c0-4782-bc23-fc7d1c6c5266 admin admin] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.118909 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793fe3c-76c0-4782-bc23-fc7d1c6c5266 admin admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.119182 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793fe3c-76c0-4782-bc23-fc7d1c6c5266 admin admin] PATH_INFO: `/v3/roles` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.119938 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793fe3c-76c0-4782-bc23-fc7d1c6c5266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:05.120969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: WARNING py.warnings [None req-7793fe3c-76c0-4782-bc23-fc7d1c6c5266 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 13:51:05.120969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: warnings.warn(msg) May 25 13:51:05.120969 dv-cinder-803823-8-smb devstack@keystone.service[86643]: May 25 13:51:05.121852 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793fe3c-76c0-4782-bc23-fc7d1c6c5266 admin admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:05.136633 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 745/1500] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 13:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:05.140927 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eae4e-0b1c-4d32-8adb-3b59fded8dd6 admin admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:05.152051 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eae4e-0b1c-4d32-8adb-3b59fded8dd6 admin admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:05.156602 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16222380-4769-4bfc-a8bb-ecceef82ed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:05.157472 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16222380-4769-4bfc-a8bb-ecceef82ed19 admin admin] REQUEST_METHOD: `PUT` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.157749 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16222380-4769-4bfc-a8bb-ecceef82ed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.158017 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16222380-4769-4bfc-a8bb-ecceef82ed19 admin admin] PATH_INFO: `/v3/projects/d26096493adf49ccbc48e3769a0c5987/users/dfcac33ec0b14ad0af28b22de90f4a85/roles/4a110f9a625548a990ed70fad43f73b0` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.172701 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16222380-4769-4bfc-a8bb-ecceef82ed19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26096493adf49ccbc48e3769a0c5987, user_id=dfcac33ec0b14ad0af28b22de90f4a85, role_id=4a110f9a625548a990ed70fad43f73b0)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:05.173738 dv-cinder-803823-8-smb devstack@keystone.service[86644]: WARNING py.warnings [None req-16222380-4769-4bfc-a8bb-ecceef82ed19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:51:05.173738 dv-cinder-803823-8-smb devstack@keystone.service[86644]: warnings.warn(msg) May 25 13:51:05.173738 dv-cinder-803823-8-smb devstack@keystone.service[86644]: May 25 13:51:05.175813 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16222380-4769-4bfc-a8bb-ecceef82ed19 admin admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:05.188646 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 756/1501] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 13:51:05 2022] PUT /identity/v3/projects/d26096493adf49ccbc48e3769a0c5987/users/dfcac33ec0b14ad0af28b22de90f4a85/roles/4a110f9a625548a990ed70fad43f73b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:05.200968 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017acdeb-f609-4801-9bae-f930c97860a0 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.201257 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017acdeb-f609-4801-9bae-f930c97860a0 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.201533 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017acdeb-f609-4801-9bae-f930c97860a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.228162 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-017acdeb-f609-4801-9bae-f930c97860a0 None None] MFA Rules not processed for user `dfcac33ec0b14ad0af28b22de90f4a85`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:05.229328 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-017acdeb-f609-4801-9bae-f930c97860a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:05.292780 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 746/1502] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 13:51:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:05.306675 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d94c72-21a9-4bd1-b4b3-80f2145d7d7f None None] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.306964 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d94c72-21a9-4bd1-b4b3-80f2145d7d7f None None] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.307241 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d94c72-21a9-4bd1-b4b3-80f2145d7d7f None None] PATH_INFO: `/` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.308659 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 757/1503] 10.222.0.24 () {54 vars in 963 bytes} [Wed May 25 13:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:05.313707 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ec7b5-e602-4465-91f7-f20f1d510be0 None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.313994 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ec7b5-e602-4465-91f7-f20f1d510be0 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.314270 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ec7b5-e602-4465-91f7-f20f1d510be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.333399 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-007ec7b5-e602-4465-91f7-f20f1d510be0 None None] MFA Rules not processed for user `ac053a5b34cb4fd8a4fb8b0dfa80e922`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:05.334638 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-007ec7b5-e602-4465-91f7-f20f1d510be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:05.378919 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:05.387284 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 747/1504] 10.222.0.24 () {58 vars in 1060 bytes} [Wed May 25 13:51:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:05.499861 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d94c72-21a9-4bd1-b4b3-80f2145d7d7f None None] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:05.510864 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d94c72-21a9-4bd1-b4b3-80f2145d7d7f None None] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:05.514546 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeba533-a0c4-4eb9-b86a-f35a708d4843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac053a5b34cb4fd8a4fb8b0dfa80e922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:05.515170 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeba533-a0c4-4eb9-b86a-f35a708d4843 service cinder] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.515454 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeba533-a0c4-4eb9-b86a-f35a708d4843 service cinder] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.515733 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeba533-a0c4-4eb9-b86a-f35a708d4843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.524652 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeba533-a0c4-4eb9-b86a-f35a708d4843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:05.526088 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeba533-a0c4-4eb9-b86a-f35a708d4843 service cinder] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:05.535639 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 758/1505] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:51:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:05.577132 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc44ac-66d7-42c8-b6d1-a9f9aea3d691 None None] REQUEST_METHOD: `GET` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.577538 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc44ac-66d7-42c8-b6d1-a9f9aea3d691 None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.577908 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc44ac-66d7-42c8-b6d1-a9f9aea3d691 None None] PATH_INFO: `/` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.579405 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 748/1506] 10.222.0.24 () {52 vars in 829 bytes} [Wed May 25 13:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:05.583612 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeba533-a0c4-4eb9-b86a-f35a708d4843 service cinder] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:05.644635 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeba533-a0c4-4eb9-b86a-f35a708d4843 service cinder] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:05.649130 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:05.649992 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.650274 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.650546 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] PATH_INFO: `/v3/users/dfcac33ec0b14ad0af28b22de90f4a85` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.651708 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfcac33ec0b14ad0af28b22de90f4a85)` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:05.652777 dv-cinder-803823-8-smb devstack@keystone.service[86644]: WARNING py.warnings [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:51:05.652777 dv-cinder-803823-8-smb devstack@keystone.service[86644]: warnings.warn(msg) May 25 13:51:05.652777 dv-cinder-803823-8-smb devstack@keystone.service[86644]: May 25 13:51:05.653971 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:05.719882 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfcac33ec0b14ad0af28b22de90f4a85'} {{(pid=86644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.720667 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfcac33ec0b14ad0af28b22de90f4a85'} {{(pid=86644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.739763 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfcac33ec0b14ad0af28b22de90f4a85'} {{(pid=86644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.740468 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfcac33ec0b14ad0af28b22de90f4a85'} {{(pid=86644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.750560 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.notifications [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfcac33ec0b14ad0af28b22de90f4a85'} {{(pid=86644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.759443 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:05.771456 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 759/1507] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 13:51:05 2022] DELETE /identity/v3/users/dfcac33ec0b14ad0af28b22de90f4a85 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:05.775893 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44972c69-f675-454c-a507-545fda57ffcc None None] REQUEST_METHOD: `POST` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.776210 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44972c69-f675-454c-a507-545fda57ffcc None None] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.776587 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44972c69-f675-454c-a507-545fda57ffcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.794618 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.auth.core [None req-44972c69-f675-454c-a507-545fda57ffcc None None] MFA Rules not processed for user `aa8d5e1bfe92436d9d6f59e103786334`. Rule list: `[]` (Enabled: `True`). {{(pid=86643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:05.795832 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-44972c69-f675-454c-a507-545fda57ffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:05.854303 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 749/1508] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 13:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:05.864679 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] Authenticating user token {{(pid=86644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:05.866274 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.fernet_utils [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:05.924746 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fccf6-d13d-40a1-8de4-d5cbab8a753d admin admin] Validating token access rules against request {{(pid=86644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:05.928629 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca73d80-dae2-4913-8bb3-71c514563fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29f2382dd6f4f648c31f12240ba5793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b57fe974dc4d4542a1dd930fc6912d39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:05.929281 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca73d80-dae2-4913-8bb3-71c514563fae service neutron] REQUEST_METHOD: `GET` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.929562 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca73d80-dae2-4913-8bb3-71c514563fae service neutron] SCRIPT_NAME: `/identity` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.929837 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca73d80-dae2-4913-8bb3-71c514563fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.938806 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca73d80-dae2-4913-8bb3-71c514563fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:05.940687 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca73d80-dae2-4913-8bb3-71c514563fae service neutron] RBAC: Authorization granted {{(pid=86644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:05.951087 dv-cinder-803823-8-smb devstack@keystone.service[86644]: [pid: 86644|app: 0|req: 760/1509] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 13:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:06.318520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44972c69-f675-454c-a507-545fda57ffcc None None] Authenticating user token {{(pid=86643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:06.318520 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.fernet_utils [None req-44972c69-f675-454c-a507-545fda57ffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:06.327426 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44972c69-f675-454c-a507-545fda57ffcc None None] Validating token access rules against request {{(pid=86643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:06.332290 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8d5e1bfe92436d9d6f59e103786334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909371a65bb348a1b58a2f6624e12486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:06.333215 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.333420 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.333692 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] PATH_INFO: `/v3/projects/d26096493adf49ccbc48e3769a0c5987` {{(pid=86643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.334884 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26096493adf49ccbc48e3769a0c5987)` {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:06.335906 dv-cinder-803823-8-smb devstack@keystone.service[86643]: WARNING py.warnings [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:51:06.335906 dv-cinder-803823-8-smb devstack@keystone.service[86643]: warnings.warn(msg) May 25 13:51:06.335906 dv-cinder-803823-8-smb devstack@keystone.service[86643]: May 25 13:51:06.337180 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] RBAC: Authorization granted {{(pid=86643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:06.400556 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26096493adf49ccbc48e3769a0c5987', 'request_id': 'req-f13622e0-826e-483b-9baf-a5a93bd106e2'} {{(pid=86643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:06.413981 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26096493adf49ccbc48e3769a0c5987', 'request_id': 'req-f13622e0-826e-483b-9baf-a5a93bd106e2'} {{(pid=86643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:06.420141 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26096493adf49ccbc48e3769a0c5987', 'request_id': 'req-f13622e0-826e-483b-9baf-a5a93bd106e2'} {{(pid=86643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:06.435317 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] The token cache is being invalidate because project d26096493adf49ccbc48e3769a0c5987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:06.435611 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:06.436273 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG keystone.notifications [None req-f13622e0-826e-483b-9baf-a5a93bd106e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:06.437918 dv-cinder-803823-8-smb devstack@keystone.service[86643]: [pid: 86643|app: 0|req: 750/1510] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 13:51:06 2022] DELETE /identity/v3/projects/d26096493adf49ccbc48e3769a0c5987 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:15.946853 dv-cinder-803823-8-smb devstack@keystone.service[86644]: DEBUG dbcounter [-] [86644] Writing DB stats keystone:SELECT=29 {{(pid=86644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:16.432251 dv-cinder-803823-8-smb devstack@keystone.service[86643]: DEBUG dbcounter [-] [86643] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}